Oct 29 23:12:26.941766 ip-10-0-134-8 systemd[1]: Starting Kubernetes Kubelet...
Oct 29 23:12:27.318204 ip-10-0-134-8 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 29 23:12:27.318204 ip-10-0-134-8 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 29 23:12:27.318204 ip-10-0-134-8 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 29 23:12:27.318204 ip-10-0-134-8 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 29 23:12:27.323570 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323462    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.323570 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323565    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.323570 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323570    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.323570 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323574    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.323570 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323579    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323586    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323592    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323596    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323600    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323604    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323617    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323621    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323625    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323629    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323633    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323636    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323640    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323645    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323649    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323653    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323657    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323662    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323666    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323670    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.323867 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323674    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323677    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323681    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323685    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323689    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323693    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323697    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323701    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323706    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323710    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323715    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323719    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323723    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323728    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323733    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323738    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323743    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323748    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323752    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323757    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.324787 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323761    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323766    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323771    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323775    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323779    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323783    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323788    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323792    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323796    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323801    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323806    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323811    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323815    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323819    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323823    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323827    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323832    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323836    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323840    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323844    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.325675 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323849    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323853    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323858    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323862    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323866    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323871    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323876    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323880    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323885    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323889    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323894    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323898    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323903    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323907    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323911    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323916    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323920    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323924    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323929    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.326505 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323933    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323937    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323942    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323946    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323951    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323955    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323959    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323963    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323967    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323971    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323976    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323983    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323988    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.323995    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324000    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324004    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324009    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324013    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324019    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.327319 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324024    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324028    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324033    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.324037    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325317    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325329    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325334    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325338    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325345    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325352    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325358    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325362    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325367    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325371    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325376    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325380    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325385    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325390    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325397    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.327810 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325402    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325407    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325412    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325418    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325422    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325426    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325431    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325435    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325439    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325444    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325448    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325452    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325457    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325462    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325466    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325470    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325492    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325497    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325502    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.328266 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325507    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325511    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325516    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325520    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325524    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325529    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325533    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325537    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325541    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325546    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325551    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325555    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325559    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325563    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325567    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325571    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325575    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325580    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325584    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325588    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.329051 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325592    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325596    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325600    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325604    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325609    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325614    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325618    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325622    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325627    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325631    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325635    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325640    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325644    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325648    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325653    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325657    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325661    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325666    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325670    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.329923 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325675    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325679    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325683    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325687    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325691    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325695    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325699    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325703    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325707    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325711    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325716    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325720    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325725    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325729    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325733    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325737    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325741    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325745    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325751    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325755    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.330785 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325759    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325763    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325768    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325772    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325776    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325780    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325787    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325792    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325797    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325801    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325808    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325812    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.325817    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326719    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326731    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326737    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326765    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326773    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326778    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.331338 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326782    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326787    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326792    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326797    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326801    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326805    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326809    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326814    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326818    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326822    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326826    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326830    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326834    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326838    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326843    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326847    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326851    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326856    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326860    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326864    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.331812 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326869    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326874    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326878    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326883    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326887    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326891    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326895    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326899    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326904    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326909    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326913    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326918    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326922    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326926    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326930    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326935    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326939    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326943    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326947    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.332276 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326950    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326954    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326959    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326963    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326968    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326974    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326978    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326983    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326987    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326991    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.326995    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327000    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327004    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327008    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327013    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327018    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327022    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327027    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327031    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.332788 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327035    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327039    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327045    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327049    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327053    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327058    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327062    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327066    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327071    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327075    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327078    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327082    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327086    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327091    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327096    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327100    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327105    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327109    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327113    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327117    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.333236 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327121    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327125    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327129    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327133    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327138    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327143    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327147    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327151    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327156    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327163    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327169    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327174    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327179    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327183    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327188    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327192    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327196    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327200    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327205    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.333714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327208    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327213    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.327217    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328346    2577 flags.go:64] FLAG: --address="0.0.0.0"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328362    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328374    2577 flags.go:64] FLAG: --anonymous-auth="true"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328382    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328389    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328394    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328401    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328407    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328413    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328418    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328424    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328430    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328435    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328439    2577 flags.go:64] FLAG: --cgroup-root=""
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328445    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328449    2577 flags.go:64] FLAG: --client-ca-file=""
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328454    2577 flags.go:64] FLAG: --cloud-provider="external"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328459    2577 flags.go:64] FLAG: --cluster-dns="[]"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328464    2577 flags.go:64] FLAG: --cluster-domain=""
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328470    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328488    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 29 23:12:27.334208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328493    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328499    2577 flags.go:64] FLAG: --container-log-max-files="5"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328515    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328520    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328525    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328531    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328536    2577 flags.go:64] FLAG: --contention-profiling="false"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328541    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328545    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328550    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328555    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328562    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328567    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328572    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328577    2577 flags.go:64] FLAG: --enable-load-reader="false"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328581    2577 flags.go:64] FLAG: --enable-server="true"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328586    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328593    2577 flags.go:64] FLAG: --event-burst="100"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328598    2577 flags.go:64] FLAG: --event-qps="50"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328604    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328609    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328614    2577 flags.go:64] FLAG: --eviction-hard=""
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328621    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328626    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328631    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 29 23:12:27.334816 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328638    2577 flags.go:64] FLAG: --eviction-soft=""
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328644    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328648    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328653    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328658    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328663    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328669    2577 flags.go:64] FLAG: --fail-swap-on="true"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328676    2577 flags.go:64] FLAG: --feature-gates=""
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328683    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328689    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328694    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328699    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328704    2577 flags.go:64] FLAG: --healthz-port="10248"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328709    2577 flags.go:64] FLAG: --help="false"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328715    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328720    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328725    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328730    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328735    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328741    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328746    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328750    2577 flags.go:64] FLAG: --image-service-endpoint=""
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328755    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 29 23:12:27.335423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328760    2577 flags.go:64] FLAG: --kube-api-burst="100"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328764    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328771    2577 flags.go:64] FLAG: --kube-api-qps="50"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328775    2577 flags.go:64] FLAG: --kube-reserved=""
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328780    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328784    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328789    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328794    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328799    2577 flags.go:64] FLAG: --lock-file=""
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328805    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328810    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328815    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328824    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328829    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328834    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328838    2577 flags.go:64] FLAG: --logging-format="text"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328847    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328853    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328858    2577 flags.go:64] FLAG: --manifest-url=""
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328863    2577 flags.go:64] FLAG: --manifest-url-header=""
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328876    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328881    2577 flags.go:64] FLAG: --max-open-files="1000000"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328887    2577 flags.go:64] FLAG: --max-pods="110"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328892    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328897    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 29 23:12:27.335979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328902    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328907    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328912    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328917    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328922    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328933    2577 flags.go:64] FLAG: --node-status-max-images="50"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328939    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328944    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328949    2577 flags.go:64] FLAG: --pod-cidr=""
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328954    2577 flags.go:64] FLAG: --pod-manifest-path=""
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328958    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328963    2577 flags.go:64] FLAG: --pods-per-core="0"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328967    2577 flags.go:64] FLAG: --port="10250"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328972    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328977    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-018abf08465cf5a72"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328982    2577 flags.go:64] FLAG: --qos-reserved=""
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328989    2577 flags.go:64] FLAG: --read-only-port="10255"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328994    2577 flags.go:64] FLAG: --register-node="true"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.328999    2577 flags.go:64] FLAG: --register-with-taints=""
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329005    2577 flags.go:64] FLAG: --registry-burst="10"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329009    2577 flags.go:64] FLAG: --registry-qps="5"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329013    2577 flags.go:64] FLAG: --reserved-cpus=""
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329018    2577 flags.go:64] FLAG: --reserved-memory=""
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329026    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329032    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329037    2577 flags.go:64] FLAG: --rotate-certificates="false"
Oct 29 23:12:27.336615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329042    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329047    2577 flags.go:64] FLAG: --runonce="false"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329052    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329056    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329061    2577 flags.go:64] FLAG: --seccomp-default="false"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329065    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329070    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329075    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329080    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329085    2577 flags.go:64] FLAG: --storage-driver-password="root"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329090    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329095    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329099    2577 flags.go:64] FLAG: --storage-driver-user="root"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329105    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329110    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329115    2577 flags.go:64] FLAG: --system-cgroups=""
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329119    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329128    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329133    2577 flags.go:64] FLAG: --tls-cert-file=""
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329138    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329144    2577 flags.go:64] FLAG: --tls-min-version=""
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329148    2577 flags.go:64] FLAG: --tls-private-key-file=""
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329155    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329159    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329164    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 29 23:12:27.337615 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329169    2577 flags.go:64] FLAG: --v="2"
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329176    2577 flags.go:64] FLAG: --version="false"
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329183    2577 flags.go:64] FLAG: --vmodule=""
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329189    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329196    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329411    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329419    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329424    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329428    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329432    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329436    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329440    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329445    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329449    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329453    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329457    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329461    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329465    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329469    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329489    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.338348 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329495    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329499    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329503    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329508    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329512    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329516    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329520    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329524    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329528    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329535    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329539    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329544    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329548    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329553    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329557    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329562    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329571    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329575    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329582    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.338840 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329589    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329594    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329599    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329603    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329608    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329613    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329617    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329621    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329625    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329630    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329634    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329637    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329642    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329646    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329651    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329655    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329659    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329663    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329668    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329672    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.339294 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329676    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329681    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329688    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329692    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329697    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329701    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329705    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329709    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329713    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329720    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329725    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329729    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329734    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329738    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329743    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329747    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329751    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329755    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329759    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329764    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.339780 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329768    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329772    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329776    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329781    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329785    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329789    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329793    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329797    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329801    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329808    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329813    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329818    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329822    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329826    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329832    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329836    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329840    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329844    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329849    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.340262 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329853    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329857    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329863    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329868    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329872    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329876    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329880    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329886    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329890    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329894    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329898    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329902    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.329906    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.329950    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330430    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330440    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.340771 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330444    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330449    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330453    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330457    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330462    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330466    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330470    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330488    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330494    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330499    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330503    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330510    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330514    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330518    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330523    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330527    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330531    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330535    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330540    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330544    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.341155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330549    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330553    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330558    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330562    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330567    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330570    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330575    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330579    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330583    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330588    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330592    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330596    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330600    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330604    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330608    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330613    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330617    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330621    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330626    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330630    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.341631 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330635    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330640    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330644    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330649    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330653    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330665    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330670    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330676    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330683    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330688    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330694    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330699    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330703    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330709    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330714    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330718    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330723    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330728    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330733    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.342098 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330737    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330741    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330745    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330750    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330754    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330758    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330762    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330767    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330771    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330775    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330779    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330783    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330787    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330791    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330795    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330799    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330803    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330807    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330812    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330816    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.342556 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330821    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330825    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330829    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330833    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330838    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330842    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330846    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330850    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330854    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330858    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330862    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330871    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330875    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330879    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330884    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330888    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330892    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330896    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330925    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.343031 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330943    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330947    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330951    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330953    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330956    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.330959    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.339363    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.339379    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.339397    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.339401    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339461    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339467    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339471    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339487    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339492    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339495    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339498    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339501    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339504    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.343538 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339506    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339509    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339512    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339514    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339517    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339519    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339522    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339524    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339527    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339530    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339532    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339535    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339538    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339540    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339543    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339546    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339548    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339556    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339559    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339562    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.343989 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339565    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339568    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339571    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339573    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339576    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339578    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339581    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339584    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339586    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339589    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339591    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339595    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339600    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339604    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339606    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339609    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339611    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339614    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339617    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.344529 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339620    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339623    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339626    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339628    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339631    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339634    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339636    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339639    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339642    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339644    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339647    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339649    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339652    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339655    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339658    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339661    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339664    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339667    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339669    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339672    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.344966 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339674    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339677    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339679    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339682    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339685    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339688    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339690    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339693    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339695    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339698    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339700    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339704    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339706    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339709    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339711    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339714    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339717    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339719    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339722    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339724    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.345433 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339726    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339729    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339732    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339736    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339740    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339743    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339745    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339748    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339751    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339754    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339756    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339759    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339761    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339764    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339767    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339769    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339772    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.345915 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339774    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.339802    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339948    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339953    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339956    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339958    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339961    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339964    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339967    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339969    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339972    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339974    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339977    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339980    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339982    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.346307 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339985    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339988    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339990    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339993    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.339996    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340000    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340002    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340005    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340008    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340010    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340013    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340015    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340018    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340021    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340025    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340029    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340032    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340035    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340038    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340040    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.346718 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340043    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340045    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340048    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340050    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340053    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340057    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340060    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340062    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340065    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340067    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340070    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340072    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340075    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340077    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340080    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340084    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340087    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340090    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340093    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340095    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.347193 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340098    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340101    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340103    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340106    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340109    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340111    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340114    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340117    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340119    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340122    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340124    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340126    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340129    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340132    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340134    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340137    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340139    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340142    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340147    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340150    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.347714 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340153    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340155    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340158    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340161    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340163    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340166    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340168    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340171    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340173    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340176    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340179    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340181    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340184    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340186    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340189    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340191    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340194    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340196    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340199    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.348221 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340201    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340204    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340207    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340209    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340211    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340214    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340216    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340219    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340222    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340224    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340227    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340230    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340233    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340236    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.340259    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340291    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:12:27.348748 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340295    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340299    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340302    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340304    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340307    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340310    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340313    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340315    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340318    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340320    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340323    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340325    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340328    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340331    2577 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340333    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340336    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340338    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340341    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340343    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340346    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:12:27.349128 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340348    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340351    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340354    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340356    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340359    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340362    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340365    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340367    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340370    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340374    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340377    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340379    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340381    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340384    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340387    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340390    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340392    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340395    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340397    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:12:27.349621 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340400    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340403    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340405    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340408    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340410    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340413    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340415    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340418    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340420    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340423    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340425    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340428    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340430    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340432    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340435    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340437    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340440    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340443    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340445    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:12:27.350087 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340448    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340450    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340452    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340455    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340458    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340461    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340463    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340466    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340468    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340471    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340473    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340491    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340495    2577 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340498    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340500    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340503    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340505    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340508    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340510    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:12:27.350543 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340513    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340515    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340518    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340521    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340524    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340528    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340531    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340534    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340537    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340539    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340542    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340545    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340548    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340550    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340553    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340555    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340558    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340561    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340564    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340567    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:12:27.350987 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340569    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340572    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340574    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340577    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340580    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340584    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340587    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:27.340590    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.340648    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.343124    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.344243    2577 server.go:1014] "Starting client certificate rotation"
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.344339    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.344372    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.346551    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 29 23:12:27.351499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.347694    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 29 23:12:27.361145 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.361128    2577 log.go:25] "Validated CRI v1 runtime API"
Oct 29 23:12:27.365027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.365014    2577 log.go:25] "Validated CRI v1 image API"
Oct 29 23:12:27.365880 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.365857    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 29 23:12:27.370035 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.370015    2577 fs.go:135] Filesystem UUIDs: map[33ddb0c0-06ba-48df-a54e-e5bd8b54f2d9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9f501e45-79a3-4302-8385-64678565ed3d:/dev/nvme0n1p3]
Oct 29 23:12:27.370094 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.370033    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 29 23:12:27.377245 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.377126    2577 manager.go:217] Machine: {Timestamp:2026-10-29 23:12:27.375523308 +0000 UTC m=+0.342160645 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098788 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2834a12ea88b6b0e3f08fce37e6f94 SystemUUID:ec2834a1-2ea8-8b6b-0e3f-08fce37e6f94 BootID:0cf45279-e949-4f62-a2f7-9ae8326aa23e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:dd:7f:25:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:dd:7f:25:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:31:95:6e:e0:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 29 23:12:27.377245 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.377237    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 29 23:12:27.377412 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.377346    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 29 23:12:27.381013 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.380989    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 29 23:12:27.381140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.381014    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 29 23:12:27.381190 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.381143    2577 topology_manager.go:143] "Creating topology manager with none policy"
Oct 29 23:12:27.381190 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.381151    2577 container_manager_linux.go:311] "Creating device plugin manager"
Oct 29 23:12:27.381190 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.381186    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 29 23:12:27.381278 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.381204    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 29 23:12:27.382414 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.382404    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 29 23:12:27.387025 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.387012    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 29 23:12:27.387157 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.387148    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 29 23:12:27.387973 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.387963    2577 kubelet.go:493] "Attempting to sync node with API server"
Oct 29 23:12:27.388020 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.387976    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 29 23:12:27.388020 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.387991    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 29 23:12:27.388020 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.388000    2577 kubelet.go:405] "Adding apiserver pod source"
Oct 29 23:12:27.388020 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.388007    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 29 23:12:27.388362 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.388348    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 29 23:12:27.390908 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.390891    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 29 23:12:27.397944 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.397932    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 29 23:12:27.398918 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.398905    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 29 23:12:27.398956 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.398941    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 29 23:12:27.399098 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399087    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 29 23:12:27.399135 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399103    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 29 23:12:27.399135 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399110    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 29 23:12:27.399135 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399115    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 29 23:12:27.399135 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399120    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 29 23:12:27.399135 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399126    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 29 23:12:27.399827 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399818    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 29 23:12:27.399827 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399826    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 29 23:12:27.399881 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399833    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 29 23:12:27.399881 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399839    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 29 23:12:27.399881 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399848    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 29 23:12:27.399881 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.399856    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 29 23:12:27.400499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.400470    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 29 23:12:27.400499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.400489    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 29 23:12:27.404485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.404465    2577 server.go:1263] "Started kubelet"
Oct 29 23:12:27.404653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.404569    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 29 23:12:27.404715 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.404657    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 29 23:12:27.404715 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.404676    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 29 23:12:27.405267 ip-10-0-134-8 systemd[1]: Started Kubernetes Kubelet.
Oct 29 23:12:27.406085 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.406071    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 29 23:12:27.409970 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.409955    2577 server.go:317] "Adding debug handlers to kubelet server"
Oct 29 23:12:27.412453 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.412436    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 29 23:12:27.413740 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.413719    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 29 23:12:27.415090 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.415075    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 29 23:12:27.415225 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.415189    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:27.415841 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.415827    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 29 23:12:27.415911 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.415846    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 29 23:12:27.415911 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.415826    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 29 23:12:27.415975 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.415928    2577 reconstruct.go:97] "Volume reconstruction finished"
Oct 29 23:12:27.415975 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.415935    2577 reconciler.go:29] "Reconciler: start to sync state"
Oct 29 23:12:27.416322 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416308    2577 factory.go:55] Registering systemd factory
Oct 29 23:12:27.416355 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416327    2577 factory.go:223] Registration of the systemd container factory successfully
Oct 29 23:12:27.416572 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416559    2577 factory.go:153] Registering CRI-O factory
Oct 29 23:12:27.416616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416576    2577 factory.go:223] Registration of the crio container factory successfully
Oct 29 23:12:27.416653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416639    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 29 23:12:27.416686 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416657    2577 factory.go:103] Registering Raw factory
Oct 29 23:12:27.416686 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.416671    2577 manager.go:1199] Started watching for new ooms in manager
Oct 29 23:12:27.417869 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.417854    2577 manager.go:319] Starting recovery of all containers
Oct 29 23:12:27.429748 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.429731    2577 manager.go:324] Recovery completed
Oct 29 23:12:27.434160 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.434144    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.435932 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.435914    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.436004 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.435945    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.436004 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.435957    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.436492 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.436468    2577 cpu_manager.go:226] "Starting" policy="none"
Oct 29 23:12:27.436492 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.436490    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 29 23:12:27.436584 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.436508    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 29 23:12:27.436584 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.436472    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.437255 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.437240    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.437325 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.437268    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.437325 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.437280    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.438709 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.438686    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 29 23:12:27.438709 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.438690    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 29 23:12:27.438855 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.438767    2577 policy_none.go:50] "Start"
Oct 29 23:12:27.438855 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.438782    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 29 23:12:27.438855 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.438795    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 29 23:12:27.439338 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.439320    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 29 23:12:27.439854 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.438691    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-8.ec2.internal.18e322fd2d39f8cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-8.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-8.ec2.internal,},FirstTimestamp:2026-10-29 23:12:27.404433613 +0000 UTC m=+0.371070950,LastTimestamp:2026-10-29 23:12:27.404433613 +0000 UTC m=+0.371070950,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-8.ec2.internal,}"
Oct 29 23:12:27.440849 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.440837    2577 policy_none.go:44] "Start"
Oct 29 23:12:27.453840 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.453822    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4l87n"
Oct 29 23:12:27.456115 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.456046    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 29 23:12:27.456115 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.456068    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 29 23:12:27.456115 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.456010    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-8.ec2.internal.18e322fd2f1a9892  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-8.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-8.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-8.ec2.internal,},FirstTimestamp:2026-10-29 23:12:27.435931794 +0000 UTC m=+0.402569130,LastTimestamp:2026-10-29 23:12:27.435931794 +0000 UTC m=+0.402569130,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-8.ec2.internal,}"
Oct 29 23:12:27.456305 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.456078    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 29 23:12:27.465586 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.465565    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4l87n"
Oct 29 23:12:27.467871 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.467831    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 29 23:12:27.470545 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.470532    2577 manager.go:341] "Starting Device Plugin manager"
Oct 29 23:12:27.470618 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.470557    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 29 23:12:27.470618 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.470565    2577 server.go:87] "Starting device plugin registration server"
Oct 29 23:12:27.470819 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.470807    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 29 23:12:27.470872 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.470821    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 29 23:12:27.471535 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.470996    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 29 23:12:27.471535 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.471062    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 29 23:12:27.471535 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.471069    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 29 23:12:27.471791 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.471769    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 29 23:12:27.471834 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.471823    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:27.477241 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.477179    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-8.ec2.internal.18e322fd2f1adfa1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-8.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-8.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-8.ec2.internal,},FirstTimestamp:2026-10-29 23:12:27.435949985 +0000 UTC m=+0.402587321,LastTimestamp:2026-10-29 23:12:27.435949985 +0000 UTC m=+0.402587321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-8.ec2.internal,}"
Oct 29 23:12:27.565197 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.565168    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 29 23:12:27.567275 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.566377    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 29 23:12:27.567275 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.566396    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 29 23:12:27.567275 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.566414    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 29 23:12:27.567275 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.566445    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 29 23:12:27.570946 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.570898    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.571734 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.571715    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.571818 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.571748    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.571818 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.571761    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.571818 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.571790    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.583171 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.583158    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:12:27.592442 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.592427    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.592509 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.592451    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-8.ec2.internal\": node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:27.632374 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.632211    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:27.666562 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.666536    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"]
Oct 29 23:12:27.666689 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.666603    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.667515 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.667498    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.667576 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.667532    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.667576 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.667543    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.669800 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.669789    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.669942 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.669929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.669986 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.669965    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.670601 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.670583    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.670679 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.670603    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.670679 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.670618    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.670679 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.670620    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.670679 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.670634    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.670679 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.670643    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.672769 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.672753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.672871 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.672776    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:27.673419 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.673403    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:27.673531 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.673431    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:27.673531 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.673441    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:27.704106 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.704090    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-8.ec2.internal\" not found" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.706850 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.706835    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-8.ec2.internal\" not found" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.732496 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.732461    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:27.817117 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.817089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.817117 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.817119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.817255 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.817159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b2fbb4e01546248a6da67f357b48b89-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"8b2fbb4e01546248a6da67f357b48b89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.833150 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.833100    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:27.917698 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.917671    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.917817 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.917742    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.917817 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.917760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.917817 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.917793    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.917817 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.917795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b2fbb4e01546248a6da67f357b48b89-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"8b2fbb4e01546248a6da67f357b48b89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.917966 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:27.917841    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b2fbb4e01546248a6da67f357b48b89-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"8b2fbb4e01546248a6da67f357b48b89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:27.933677 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:27.933641    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.006928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.006893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:28.010040 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.010022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:28.033978 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.033952    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.134527 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.134444    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.234901 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.234869    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.336062 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.336028    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.343722 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.343693    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 29 23:12:28.343856 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.343836    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 29 23:12:28.440430 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.440365    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.471662 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.471614    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:28 +0000 UTC" deadline="2028-06-30 11:39:15.932098359 +0000 UTC"
Oct 29 23:12:28.471662 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.471663    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14628h26m47.460440861s"
Oct 29 23:12:28.541262 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.541229    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.574057 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:28.574007    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2fbb4e01546248a6da67f357b48b89.slice/crio-d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d WatchSource:0}: Error finding container d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d: Status 404 returned error can't find the container with id d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d
Oct 29 23:12:28.574912 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:28.574883    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1baf8a433f591d10b63e86535dd962.slice/crio-2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0 WatchSource:0}: Error finding container 2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0: Status 404 returned error can't find the container with id 2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0
Oct 29 23:12:28.579859 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.579839    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 29 23:12:28.594694 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.594674    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:12:28.595704 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.595685    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:12:28.595788 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.595721    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:12:28.595788 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.595736    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:12:28.642191 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:28.642165    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:12:28.670869 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.670841    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:12:28.687836 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.687814    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:12:28.717109 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.717041    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:28.741536 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.741517    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 29 23:12:28.742456 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.742443    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:12:28.768704 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.768681    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 29 23:12:28.817765 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:28.817741    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:12:29.378056 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.378000    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:12:29.388274 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.388247    2577 apiserver.go:52] "Watching apiserver"
Oct 29 23:12:29.416192 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.416156    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 29 23:12:29.436437 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.436411    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 29 23:12:29.436846 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.436812    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-lw2vc","openshift-multus/multus-additional-cni-plugins-wzmpl","kube-system/global-pull-secret-syncer-l4dmt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal","openshift-multus/network-metrics-daemon-dpbxx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp","openshift-multus/multus-gcnnc","openshift-network-operator/iptables-alerter-zb2cb","kube-system/konnectivity-agent-8b26b","openshift-image-registry/node-ca-qcbhg","openshift-network-diagnostics/network-check-target-sd6x7","openshift-ovn-kubernetes/ovnkube-node-d7dc6","kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4wqmx"]
Oct 29 23:12:29.439573 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.439535    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.442141 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.442122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:29.442230 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.442196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:29.444277 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.444250    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.444406 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.444319    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:29.446546 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.446518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.448911 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.448892    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:29.449007 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.448945    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:29.451384 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.451360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.453931 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.453713    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.457058 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.456721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.458117 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.458087    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.458117 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.458103    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 29 23:12:29.458531 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.458512    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kxr2\""
Oct 29 23:12:29.458617 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.458603    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.460161 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.460138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.463288 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.463266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.464934 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.464903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.467532 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.467502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.472631 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.472603    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 29 23:12:29.472730 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.472676    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j7lgb"
Oct 29 23:12:29.517035 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.517017    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 29 23:12:29.528726 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-env-overrides\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.528834 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.528834 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-tuned\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.528961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxx7s\" (UniqueName: \"kubernetes.io/projected/23297409-95e7-435a-8bca-d70d93ea2c09-kube-api-access-nxx7s\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:29.528961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-modprobe-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.528961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-etc-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.528961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528932    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.529182 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528965    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/131528b2-b2fe-4d0d-9260-db245d108396-host-slash\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.529182 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.528994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.529182 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.529182 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppptf\" (UniqueName: \"kubernetes.io/projected/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-kube-api-access-ppptf\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.529182 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-device-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-bin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-var-lib-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-ovn\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-kubelet-config\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-multus\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.529436 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-script-lib\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/131528b2-b2fe-4d0d-9260-db245d108396-iptables-alerter-script\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysconfig\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-var-lib-kubelet\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-bin\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-conf\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4px82\" (UniqueName: \"kubernetes.io/projected/0f4d2bad-866f-4398-9654-7f726d906f8d-kube-api-access-4px82\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.529848 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-conf-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-daemon-config\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.529954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-system-cni-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cnibin\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-tmp-dir\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-registration-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-node-log\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j9z8\" (UniqueName: \"kubernetes.io/projected/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-kube-api-access-5j9z8\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-lib-modules\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530219    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-socket-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-multus-certs\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.530295 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-systemd-units\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530326    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-kubernetes\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530354    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2dcl\" (UniqueName: \"kubernetes.io/projected/5a83a964-ea7b-449e-8473-6677bf54e3b0-kube-api-access-j2dcl\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-konnectivity-ca\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530421    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-etc-kubernetes\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-sys-fs\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cnibin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-kubelet\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qtk\" (UniqueName: \"kubernetes.io/projected/87f17a44-0885-45e5-81f1-300442c926b8-kube-api-access-49qtk\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530605    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-hosts-file\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530622    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdtwq\" (UniqueName: \"kubernetes.io/projected/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-kube-api-access-sdtwq\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-tmp\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-hostroot\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-slash\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-systemd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531102 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4d414a-b040-4e77-9ddf-a37d04677415-host\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-dbus\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.530950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-system-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531050    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-netns\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531089    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87f17a44-0885-45e5-81f1-300442c926b8-ovn-node-metrics-cert\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4d414a-b040-4e77-9ddf-a37d04677415-serviceca\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7rsg\" (UniqueName: \"kubernetes.io/projected/131528b2-b2fe-4d0d-9260-db245d108396-kube-api-access-s7rsg\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531208    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-run\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-agent-certs\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-k8s-cni-cncf-io\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-netns\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531301    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-config\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wrl4\" (UniqueName: \"kubernetes.io/projected/8e4d414a-b040-4e77-9ddf-a37d04677415-kube-api-access-7wrl4\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cni-binary-copy\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-socket-dir-parent\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.531814 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.532271 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531445    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-systemd\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.532271 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-sys\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.532271 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-host\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.532271 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-kubelet\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.532271 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-log-socket\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.532271 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.531589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-netd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.565360 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565329    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 29 23:12:29.565520 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565401    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 29 23:12:29.565520 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565417    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.565783 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565764    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 29 23:12:29.565853 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565829    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.565927 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565914    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 29 23:12:29.565997 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.565986    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.566067 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566055    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 29 23:12:29.566357 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566342    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27bdq\""
Oct 29 23:12:29.566429 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566404    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.566466 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566457    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 29 23:12:29.566547 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566535    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 29 23:12:29.566669 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566657    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.566807 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566794    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4s2ql\""
Oct 29 23:12:29.566879 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.566837    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.572777 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.572222    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"ae1baf8a433f591d10b63e86535dd962","Type":"ContainerStarted","Data":"2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0"}
Oct 29 23:12:29.573636 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.573612    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" event={"ID":"8b2fbb4e01546248a6da67f357b48b89","Type":"ContainerStarted","Data":"d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d"}
Oct 29 23:12:29.580990 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.580964    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t5hzf\""
Oct 29 23:12:29.580990 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.580965    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.581170 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.580990    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lj8k\""
Oct 29 23:12:29.581170 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.580988    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.581170 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.581022    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.581170 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.581002    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nnrj\""
Oct 29 23:12:29.581170 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.581147    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 29 23:12:29.581375 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.581174    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 29 23:12:29.581375 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.581189    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.581375 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.581204    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c96z8\""
Oct 29 23:12:29.582129 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.582102    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 29 23:12:29.582240 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.582103    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 29 23:12:29.582240 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.582102    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmxkp\""
Oct 29 23:12:29.584985 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.584960    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 29 23:12:29.585201 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.585043    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 29 23:12:29.585201 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.585083    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 29 23:12:29.585201 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.585150    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcbr2\""
Oct 29 23:12:29.631911 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-hostroot\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.631911 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-slash\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.631911 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-systemd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4d414a-b040-4e77-9ddf-a37d04677415-host\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-dbus\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631955    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-hostroot\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.631976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-system-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632034    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-netns\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87f17a44-0885-45e5-81f1-300442c926b8-ovn-node-metrics-cert\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632075    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-slash\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4d414a-b040-4e77-9ddf-a37d04677415-serviceca\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632116    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-systemd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632126    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rsg\" (UniqueName: \"kubernetes.io/projected/131528b2-b2fe-4d0d-9260-db245d108396-kube-api-access-s7rsg\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-run\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632156    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4d414a-b040-4e77-9ddf-a37d04677415-host\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632159    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-netns\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632175 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-agent-certs\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-k8s-cni-cncf-io\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632205    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-system-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-netns\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-config\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrl4\" (UniqueName: \"kubernetes.io/projected/8e4d414a-b040-4e77-9ddf-a37d04677415-kube-api-access-7wrl4\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cni-binary-copy\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632316    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-socket-dir-parent\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-systemd\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632383    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-dbus\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-sys\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632396    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-netns\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-host\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632444    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-sys\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-kubelet\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-log-socket\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632485    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-host\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.632987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-netd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-env-overrides\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632555    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-socket-dir-parent\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632571    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-k8s-cni-cncf-io\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632641    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-systemd\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-tuned\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxx7s\" (UniqueName: \"kubernetes.io/projected/23297409-95e7-435a-8bca-d70d93ea2c09-kube-api-access-nxx7s\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632696    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-netd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-modprobe-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632736    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-etc-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632763    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/131528b2-b2fe-4d0d-9260-db245d108396-host-slash\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppptf\" (UniqueName: \"kubernetes.io/projected/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-kube-api-access-ppptf\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.633904 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632884    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-device-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-bin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-var-lib-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-ovn\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632984    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-kubelet\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-kubelet-config\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633032    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-ovn\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633039    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-multus\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-script-lib\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/131528b2-b2fe-4d0d-9260-db245d108396-iptables-alerter-script\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysconfig\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-var-lib-kubelet\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-bin\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.634653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-modprobe-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633326    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cni-binary-copy\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633336    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633365    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-config\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633378    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/131528b2-b2fe-4d0d-9260-db245d108396-host-slash\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633378    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-etc-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633401    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.632955    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4d414a-b040-4e77-9ddf-a37d04677415-serviceca\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633443    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-device-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.633477    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633479    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633489    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-kubelet-config\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.633548    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:30.133528909 +0000 UTC m=+3.100166253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633537    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-conf\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633754    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysconfig\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633805    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-var-lib-kubelet\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633843    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-bin\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.635478 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-conf\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4px82\" (UniqueName: \"kubernetes.io/projected/0f4d2bad-866f-4398-9654-7f726d906f8d-kube-api-access-4px82\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-conf-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-daemon-config\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.633986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-system-cni-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cnibin\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-tmp-dir\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634053    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-registration-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-node-log\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9z8\" (UniqueName: \"kubernetes.io/projected/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-kube-api-access-5j9z8\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-lib-modules\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-socket-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634190    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-run\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-multus-certs\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.636785 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-systemd-units\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634271    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-kubernetes\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dcl\" (UniqueName: \"kubernetes.io/projected/5a83a964-ea7b-449e-8473-6677bf54e3b0-kube-api-access-j2dcl\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634351    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-konnectivity-ca\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634358    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-var-lib-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-etc-kubernetes\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-sys-fs\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cnibin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-kubelet\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qtk\" (UniqueName: \"kubernetes.io/projected/87f17a44-0885-45e5-81f1-300442c926b8-kube-api-access-49qtk\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-hosts-file\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634593    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-node-log\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtwq\" (UniqueName: \"kubernetes.io/projected/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-kube-api-access-sdtwq\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634664    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-tmp\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.637609 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634705    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634713    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-bin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634738    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-conf-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634770    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cnibin\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634799    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-system-cni-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634890    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-env-overrides\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634953    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-multus\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635037    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-etc-kubernetes\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.634422    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-log-socket\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635104    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-sys-fs\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635156    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cnibin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.635161    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635198    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-kubelet\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.635312    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret podName:6cf9cc14-3177-4dc4-8f45-ab8f230d185c nodeName:}" failed. No retries permitted until 2026-10-29 23:12:30.135290764 +0000 UTC m=+3.101928104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret") pod "global-pull-secret-syncer-l4dmt" (UID: "6cf9cc14-3177-4dc4-8f45-ab8f230d185c") : object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635398    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-tmp-dir\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635463    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-hosts-file\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635484    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-registration-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635517    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-konnectivity-ca\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.638479 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635543    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635549    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635594    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-multus-certs\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635618    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-kubernetes\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635638    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-systemd-units\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635721    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-lib-modules\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635736    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-socket-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635797    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.635966    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.636030    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/131528b2-b2fe-4d0d-9260-db245d108396-iptables-alerter-script\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.636309    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-daemon-config\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.637330    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-script-lib\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.637409    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87f17a44-0885-45e5-81f1-300442c926b8-ovn-node-metrics-cert\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.637676    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-agent-certs\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.639294    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-tmp\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.639485 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.639350    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-tuned\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.654953 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.654927    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rsg\" (UniqueName: \"kubernetes.io/projected/131528b2-b2fe-4d0d-9260-db245d108396-kube-api-access-s7rsg\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.655676 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.655654    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrl4\" (UniqueName: \"kubernetes.io/projected/8e4d414a-b040-4e77-9ddf-a37d04677415-kube-api-access-7wrl4\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.656631 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.656609    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 29 23:12:29.656730 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.656635    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 29 23:12:29.656730 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.656649    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rkgfn for pod openshift-network-diagnostics/network-check-target-sd6x7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:29.656730 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:29.656726    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn podName:83b74d19-08b5-4303-9ce2-be9e520230a3 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:30.156706817 +0000 UTC m=+3.123344168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rkgfn" (UniqueName: "kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn") pod "network-check-target-sd6x7" (UID: "83b74d19-08b5-4303-9ce2-be9e520230a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:29.656907 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.656771    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxx7s\" (UniqueName: \"kubernetes.io/projected/23297409-95e7-435a-8bca-d70d93ea2c09-kube-api-access-nxx7s\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:29.661073 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.661046    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9z8\" (UniqueName: \"kubernetes.io/projected/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-kube-api-access-5j9z8\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.661181 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.661058    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppptf\" (UniqueName: \"kubernetes.io/projected/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-kube-api-access-ppptf\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.661439 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.661419    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtwq\" (UniqueName: \"kubernetes.io/projected/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-kube-api-access-sdtwq\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.661569 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.661501    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qtk\" (UniqueName: \"kubernetes.io/projected/87f17a44-0885-45e5-81f1-300442c926b8-kube-api-access-49qtk\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.661690 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.661495    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dcl\" (UniqueName: \"kubernetes.io/projected/5a83a964-ea7b-449e-8473-6677bf54e3b0-kube-api-access-j2dcl\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.663368 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.663343    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4px82\" (UniqueName: \"kubernetes.io/projected/0f4d2bad-866f-4398-9654-7f726d906f8d-kube-api-access-4px82\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.761249 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.761220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:12:29.769112 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.769082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:12:29.777608 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.776458    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e4d414a_b040_4e77_9ddf_a37d04677415.slice/crio-96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4 WatchSource:0}: Error finding container 96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4: Status 404 returned error can't find the container with id 96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4
Oct 29 23:12:29.784721 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.784697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:12:29.788636 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.788444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:29.797197 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.797039    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:12:29.798216 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.798187    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a83a964_ea7b_449e_8473_6677bf54e3b0.slice/crio-5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f WatchSource:0}: Error finding container 5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f: Status 404 returned error can't find the container with id 5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f
Oct 29 23:12:29.799827 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.799806    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b6629b_dbda_44d0_8f3e_7e3d52f84632.slice/crio-ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17 WatchSource:0}: Error finding container ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17: Status 404 returned error can't find the container with id ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17
Oct 29 23:12:29.808155 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.808126    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131528b2_b2fe_4d0d_9260_db245d108396.slice/crio-269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679 WatchSource:0}: Error finding container 269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679: Status 404 returned error can't find the container with id 269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679
Oct 29 23:12:29.820629 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.820446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:12:29.822682 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.822657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gcnnc"
Oct 29 23:12:29.825867 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.825819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:12:29.833534 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.833190    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e00bed0_7bc2_4322_b108_efb74a2ee6cd.slice/crio-00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3 WatchSource:0}: Error finding container 00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3: Status 404 returned error can't find the container with id 00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3
Oct 29 23:12:29.841593 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.836059    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9874f42_2ba3_4eba_af65_a6f114fcaaf6.slice/crio-af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec WatchSource:0}: Error finding container af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec: Status 404 returned error can't find the container with id af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec
Oct 29 23:12:29.846176 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:29.846146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:29.857270 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:29.857244    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f17a44_0885_45e5_81f1_300442c926b8.slice/crio-02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a WatchSource:0}: Error finding container 02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a: Status 404 returned error can't find the container with id 02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a
Oct 29 23:12:30.139347 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.139309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:30.139530 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.139361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:30.139530 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.139491    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:30.139530 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.139517    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:30.139665 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.139563    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret podName:6cf9cc14-3177-4dc4-8f45-ab8f230d185c nodeName:}" failed. No retries permitted until 2026-10-29 23:12:31.139547921 +0000 UTC m=+4.106185247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret") pod "global-pull-secret-syncer-l4dmt" (UID: "6cf9cc14-3177-4dc4-8f45-ab8f230d185c") : object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:30.139665 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.139586    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:31.13957432 +0000 UTC m=+4.106211650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:30.239750 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.239715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:30.239940 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.239916    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 29 23:12:30.239940 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.239943    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 29 23:12:30.240100 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.239957    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rkgfn for pod openshift-network-diagnostics/network-check-target-sd6x7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:30.240100 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.240017    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn podName:83b74d19-08b5-4303-9ce2-be9e520230a3 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:31.239998992 +0000 UTC m=+4.206636332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkgfn" (UniqueName: "kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn") pod "network-check-target-sd6x7" (UID: "83b74d19-08b5-4303-9ce2-be9e520230a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:30.476759 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.476438    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:29 +0000 UTC" deadline="2028-07-23 11:02:43.46148709 +0000 UTC"
Oct 29 23:12:30.476759 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.476762    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15179h50m12.984733069s"
Oct 29 23:12:30.567017 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.566886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:30.567193 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.567025    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:30.567409 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.567361    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:30.567490 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:30.567427    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:30.607840 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.607752    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gcnnc" event={"ID":"e9874f42-2ba3-4eba-af65-a6f114fcaaf6","Type":"ContainerStarted","Data":"af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec"}
Oct 29 23:12:30.613027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.612996    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zb2cb" event={"ID":"131528b2-b2fe-4d0d-9260-db245d108396","Type":"ContainerStarted","Data":"269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679"}
Oct 29 23:12:30.615216 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.615190    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8b26b" event={"ID":"a3b6629b-dbda-44d0-8f3e-7e3d52f84632","Type":"ContainerStarted","Data":"ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17"}
Oct 29 23:12:30.618653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.618627    2577 generic.go:356] "Generic (PLEG): container finished" podID="ae1baf8a433f591d10b63e86535dd962" containerID="2ef50ff80833b2571a8ff484cee1467b771c825f8e38b766e674364f8e6faa54" exitCode=0
Oct 29 23:12:30.618757 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.618707    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"ae1baf8a433f591d10b63e86535dd962","Type":"ContainerDied","Data":"2ef50ff80833b2571a8ff484cee1467b771c825f8e38b766e674364f8e6faa54"}
Oct 29 23:12:30.623584 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.623559    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a"}
Oct 29 23:12:30.630266 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.630241    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lw2vc" event={"ID":"2e00bed0-7bc2-4322-b108-efb74a2ee6cd","Type":"ContainerStarted","Data":"00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3"}
Oct 29 23:12:30.640633 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.640559    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp" event={"ID":"5a83a964-ea7b-449e-8473-6677bf54e3b0","Type":"ContainerStarted","Data":"5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f"}
Oct 29 23:12:30.645406 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.645325    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4wqmx" event={"ID":"0f4d2bad-866f-4398-9654-7f726d906f8d","Type":"ContainerStarted","Data":"27842c80c21aebaf08e8c048cbc0dd619d185ed2a4b2fe29bf5a73126416643e"}
Oct 29 23:12:30.649888 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.649810    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qcbhg" event={"ID":"8e4d414a-b040-4e77-9ddf-a37d04677415","Type":"ContainerStarted","Data":"96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4"}
Oct 29 23:12:30.663079 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.662615    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" event={"ID":"8b2fbb4e01546248a6da67f357b48b89","Type":"ContainerStarted","Data":"009483e401535c4fe1a79613afd63968aa6bd05daaf4d9769e7205ceaeab9179"}
Oct 29 23:12:30.671815 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:30.671787    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerStarted","Data":"c131273c1d9f389895b2bdff961edf059a8de053b0be7373939c87d1d3b0740d"}
Oct 29 23:12:31.148024 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.147897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:31.148024 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.147956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:31.148269 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.148142    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:31.148269 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.148207    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret podName:6cf9cc14-3177-4dc4-8f45-ab8f230d185c nodeName:}" failed. No retries permitted until 2026-10-29 23:12:33.148186828 +0000 UTC m=+6.114824156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret") pod "global-pull-secret-syncer-l4dmt" (UID: "6cf9cc14-3177-4dc4-8f45-ab8f230d185c") : object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:31.148387 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.148286    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:31.148387 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.148324    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:33.148311576 +0000 UTC m=+6.114948906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:31.248394 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.248317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:31.248663 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.248445    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 29 23:12:31.248663 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.248467    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 29 23:12:31.248663 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.248478    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rkgfn for pod openshift-network-diagnostics/network-check-target-sd6x7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:31.248663 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.248547    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn podName:83b74d19-08b5-4303-9ce2-be9e520230a3 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:33.248529654 +0000 UTC m=+6.215166998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkgfn" (UniqueName: "kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn") pod "network-check-target-sd6x7" (UID: "83b74d19-08b5-4303-9ce2-be9e520230a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:31.477349 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.477234    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:29 +0000 UTC" deadline="2028-05-02 17:27:47.064569478 +0000 UTC"
Oct 29 23:12:31.477349 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.477302    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13218h15m15.58727259s"
Oct 29 23:12:31.572725 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.572199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:31.572725 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:31.572349    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:31.692936 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.692480    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"ae1baf8a433f591d10b63e86535dd962","Type":"ContainerStarted","Data":"fe224d23c01e44ac35530bb404bf3a021a59211816fde0976ad85ab1a73c062e"}
Oct 29 23:12:31.737134 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:31.737022    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" podStartSLOduration=2.737000907 podStartE2EDuration="2.737000907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:30.711741124 +0000 UTC m=+3.678378478" watchObservedRunningTime="2026-10-29 23:12:31.737000907 +0000 UTC m=+4.703638258"
Oct 29 23:12:32.567703 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:32.567637    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:32.568258 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:32.567799    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:32.568258 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:32.568221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:32.568381 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:32.568321    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:33.166209 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.166163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:33.166395 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.166227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:33.166480 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.166437    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:33.166573 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.166506    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret podName:6cf9cc14-3177-4dc4-8f45-ab8f230d185c nodeName:}" failed. No retries permitted until 2026-10-29 23:12:37.166486546 +0000 UTC m=+10.133123894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret") pod "global-pull-secret-syncer-l4dmt" (UID: "6cf9cc14-3177-4dc4-8f45-ab8f230d185c") : object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:33.167107 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.166949    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:33.167107 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.167007    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:37.166991481 +0000 UTC m=+10.133628822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:33.267395 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.267329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:33.267607 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.267537    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 29 23:12:33.267607 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.267562    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 29 23:12:33.267607 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.267580    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rkgfn for pod openshift-network-diagnostics/network-check-target-sd6x7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:33.267778 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.267644    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn podName:83b74d19-08b5-4303-9ce2-be9e520230a3 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:37.267624249 +0000 UTC m=+10.234261578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkgfn" (UniqueName: "kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn") pod "network-check-target-sd6x7" (UID: "83b74d19-08b5-4303-9ce2-be9e520230a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:33.568987 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.568407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:33.568987 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:33.568556    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:33.714191 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.714144    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="f155c2067b7f61a37d1a725ba9d88d68880d01da12e6af4a0f9cbaaa16ceeca7" exitCode=0
Oct 29 23:12:33.714335 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.714217    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerDied","Data":"f155c2067b7f61a37d1a725ba9d88d68880d01da12e6af4a0f9cbaaa16ceeca7"}
Oct 29 23:12:33.797399 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:33.796202    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" podStartSLOduration=4.796185192 podStartE2EDuration="4.796185192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:31.738009385 +0000 UTC m=+4.704646736" watchObservedRunningTime="2026-10-29 23:12:33.796185192 +0000 UTC m=+6.762822542"
Oct 29 23:12:34.567351 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:34.566717    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:34.567351 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:34.566847    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:34.567351 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:34.567164    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:34.567351 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:34.567268    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:34.720583 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:34.719835    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8b26b" event={"ID":"a3b6629b-dbda-44d0-8f3e-7e3d52f84632","Type":"ContainerStarted","Data":"72ad68745b038ced23c11e8b4666521ae3b3ef4d498cc9d2c2d17ba1c45cd59c"}
Oct 29 23:12:35.569446 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:35.569408    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:35.569633 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:35.569540    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:35.729218 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:35.729183    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qcbhg" event={"ID":"8e4d414a-b040-4e77-9ddf-a37d04677415","Type":"ContainerStarted","Data":"a144c980a90e81b6ee251fed82de30d3152d18b632cc59f7348544d2eda807a6"}
Oct 29 23:12:35.769810 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:35.769750    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8b26b" podStartSLOduration=3.993143485 podStartE2EDuration="7.769731294s" totalImagesPullingTime="3.776587809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:34.765701061 +0000 UTC m=+7.732338411" watchObservedRunningTime="2026-10-29 23:12:35.769731294 +0000 UTC m=+8.736368640"
Oct 29 23:12:36.566950 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:36.566909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:36.567135 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:36.567050    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:36.567434 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:36.567418    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:36.567551 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:36.567530    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:36.732808 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:36.732768    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp" event={"ID":"5a83a964-ea7b-449e-8473-6677bf54e3b0","Type":"ContainerStarted","Data":"f2991ff655ca1339610f8186c82ee113b581642f2ae6b1949357c93e88a469b2"}
Oct 29 23:12:37.198768 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.197996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:37.198768 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.198052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:37.198768 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.198208    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:37.198768 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.198270    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret podName:6cf9cc14-3177-4dc4-8f45-ab8f230d185c nodeName:}" failed. No retries permitted until 2026-10-29 23:12:45.198252718 +0000 UTC m=+18.164890058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret") pod "global-pull-secret-syncer-l4dmt" (UID: "6cf9cc14-3177-4dc4-8f45-ab8f230d185c") : object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:37.198768 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.198685    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:37.198768 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.198733    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:45.198718537 +0000 UTC m=+18.165355875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:37.298720 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.298681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:37.298880 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.298850    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 29 23:12:37.298880 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.298870    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 29 23:12:37.298880 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.298881    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rkgfn for pod openshift-network-diagnostics/network-check-target-sd6x7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:37.299023 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.298942    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn podName:83b74d19-08b5-4303-9ce2-be9e520230a3 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:45.29892328 +0000 UTC m=+18.265560618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkgfn" (UniqueName: "kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn") pod "network-check-target-sd6x7" (UID: "83b74d19-08b5-4303-9ce2-be9e520230a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:37.385695 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.385634    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 29 23:12:37.474858 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.474225    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:12:37.385656182Z","UUID":"3be60fac-b479-437e-8126-169653e37fe4","Handler":null,"Name":"","Endpoint":""}
Oct 29 23:12:37.477339 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.476948    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 29 23:12:37.477339 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.476979    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 29 23:12:37.574253 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.574220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:37.574416 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:37.574326    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:37.738185 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:37.738097    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp" event={"ID":"5a83a964-ea7b-449e-8473-6677bf54e3b0","Type":"ContainerStarted","Data":"10143e3f57a940878c35fac013cdb03b1cf03ee8b251a6e94a22c8900ee49b13"}
Oct 29 23:12:38.113276 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.113239    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:38.299610 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.299305    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:38.299790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.299770    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:38.340083 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.340023    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qcbhg" podStartSLOduration=5.269755925 podStartE2EDuration="10.340005705s" totalImagesPullingTime="5.07024978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:35.770677418 +0000 UTC m=+8.737314786" watchObservedRunningTime="2026-10-29 23:12:38.340005705 +0000 UTC m=+11.306643052"
Oct 29 23:12:38.567076 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.566856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:38.567076 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.566856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:38.567291 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:38.567144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:38.567367 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:38.567326    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:38.743639 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.743602    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="73fee79ec345a35700d2be4fe3eea8e69de48e2e6f1ee0cb4274bfa641371ec6" exitCode=0
Oct 29 23:12:38.744100 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.743676    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerDied","Data":"73fee79ec345a35700d2be4fe3eea8e69de48e2e6f1ee0cb4274bfa641371ec6"}
Oct 29 23:12:38.750608 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.747754    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gcnnc" event={"ID":"e9874f42-2ba3-4eba-af65-a6f114fcaaf6","Type":"ContainerStarted","Data":"3db02024a31c09076fa9e9b37f6cd08ad87f6a3ea45b0cd37b02002f94ad2753"}
Oct 29 23:12:38.750608 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.749102    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lw2vc" event={"ID":"2e00bed0-7bc2-4322-b108-efb74a2ee6cd","Type":"ContainerStarted","Data":"fa9e034e3ca7972951f36e5f97003d34d3294989503cb6a6bce54383209657a5"}
Oct 29 23:12:38.752239 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.752143    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp" event={"ID":"5a83a964-ea7b-449e-8473-6677bf54e3b0","Type":"ContainerStarted","Data":"64d25208bd749c36bef152a48694309a76c703090ffa08d494434299b0122eda"}
Oct 29 23:12:38.752841 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.752819    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:12:38.831793 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.831690    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-lw2vc" podStartSLOduration=3.031508055 podStartE2EDuration="10.831669808s" totalImagesPullingTime="7.800161753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:38.830754496 +0000 UTC m=+11.797391842" watchObservedRunningTime="2026-10-29 23:12:38.831669808 +0000 UTC m=+11.798307154"
Oct 29 23:12:38.875510 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.875440    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-gcnnc" podStartSLOduration=2.764319414 podStartE2EDuration="10.875422554s" totalImagesPullingTime="8.11110314s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:38.874860769 +0000 UTC m=+11.841498117" watchObservedRunningTime="2026-10-29 23:12:38.875422554 +0000 UTC m=+11.842059903"
Oct 29 23:12:38.918020 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:38.917969    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp" podStartSLOduration=2.759944653 podStartE2EDuration="10.917957955s" totalImagesPullingTime="8.158013302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:38.917788156 +0000 UTC m=+11.884425502" watchObservedRunningTime="2026-10-29 23:12:38.917957955 +0000 UTC m=+11.884595303"
Oct 29 23:12:39.567262 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:39.567199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:39.567417 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:39.567327    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:39.756934 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:39.756896    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="37de8547b33f539c689210b5456b30f0e1c109ff2fa8b4b7de2f0eea362b02c2" exitCode=0
Oct 29 23:12:39.757407 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:39.756993    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerDied","Data":"37de8547b33f539c689210b5456b30f0e1c109ff2fa8b4b7de2f0eea362b02c2"}
Oct 29 23:12:39.758698 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:39.758659    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zb2cb" event={"ID":"131528b2-b2fe-4d0d-9260-db245d108396","Type":"ContainerStarted","Data":"294433378e2c87d50ea377ad9ecbd4e5512581d3f87093649263627e4ba087b6"}
Oct 29 23:12:39.846821 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:39.846711    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zb2cb" podStartSLOduration=3.821790134 podStartE2EDuration="11.846692789s" totalImagesPullingTime="8.024902655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:39.846471815 +0000 UTC m=+12.813109161" watchObservedRunningTime="2026-10-29 23:12:39.846692789 +0000 UTC m=+12.813330136"
Oct 29 23:12:40.567191 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:40.567162    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:40.567322 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:40.567205    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:40.567376 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:40.567322    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:40.567508 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:40.567456    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:40.762865 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:40.762631    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4wqmx" event={"ID":"0f4d2bad-866f-4398-9654-7f726d906f8d","Type":"ContainerStarted","Data":"1d8a44fed1661d51802b96062d0f7c6212615eb22d504900b1a537570ab6d942"}
Oct 29 23:12:40.765528 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:40.765499    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="9cee9a507334a6e5e8178857f0f641024e99197a274045735bc458ac50a39efc" exitCode=0
Oct 29 23:12:40.765676 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:40.765588    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerDied","Data":"9cee9a507334a6e5e8178857f0f641024e99197a274045735bc458ac50a39efc"}
Oct 29 23:12:40.804761 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:40.804713    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4wqmx" podStartSLOduration=2.383904088 podStartE2EDuration="12.804696452s" totalImagesPullingTime="10.420792364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:40.804522925 +0000 UTC m=+13.771160273" watchObservedRunningTime="2026-10-29 23:12:40.804696452 +0000 UTC m=+13.771333801"
Oct 29 23:12:41.568673 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:41.568644    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:41.568836 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:41.568748    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:42.567553 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:42.567525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:42.567553 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:42.567553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:42.568320 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:42.567643    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:42.568320 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:42.567784    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:42.776157 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:42.775914    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerStarted","Data":"5da10aff2c9083eb2349ae857efa0c05b12a9160449dd7da3f0049f875b8c00b"}
Oct 29 23:12:43.566899 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:43.566864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:43.567101 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:43.566993    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:43.781360 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:43.781322    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="5da10aff2c9083eb2349ae857efa0c05b12a9160449dd7da3f0049f875b8c00b" exitCode=0
Oct 29 23:12:43.781792 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:43.781385    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerDied","Data":"5da10aff2c9083eb2349ae857efa0c05b12a9160449dd7da3f0049f875b8c00b"}
Oct 29 23:12:44.567086 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.567032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:44.567272 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.567088    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:44.567272 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:44.567149    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:44.567272 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:44.567204    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:44.785676 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.785649    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"bf1a62cf17f5c622c52c66e6bc2741be8897f80d44c25614ddb9abcba204eb59"}
Oct 29 23:12:44.785986 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.785709    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"3945dd0443b34957320f55b36ba0b8b90c4e3c0ce841c7ea5ea3e6b9badbfb05"}
Oct 29 23:12:44.785986 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.785751    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"bfd8468b7c62bbed54df223a7e9dba2056540afc54b644be5fbb48506b62a21e"}
Oct 29 23:12:44.788730 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.788705    2577 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="b1189e8930e8e1079d2a5c6204cbdec8ce4253b721d2ece2d5e1fea7cbd4531e" exitCode=0
Oct 29 23:12:44.788822 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:44.788747    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerDied","Data":"b1189e8930e8e1079d2a5c6204cbdec8ce4253b721d2ece2d5e1fea7cbd4531e"}
Oct 29 23:12:45.259706 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.259542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:45.259839 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.259722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:45.259839 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.259683    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:45.259839 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.259831    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:01.259816675 +0000 UTC m=+34.226454003 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 29 23:12:45.259839 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.259835    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:45.259985 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.259875    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret podName:6cf9cc14-3177-4dc4-8f45-ab8f230d185c nodeName:}" failed. No retries permitted until 2026-10-29 23:13:01.259863847 +0000 UTC m=+34.226501184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret") pod "global-pull-secret-syncer-l4dmt" (UID: "6cf9cc14-3177-4dc4-8f45-ab8f230d185c") : object "kube-system"/"original-pull-secret" not registered
Oct 29 23:12:45.360872 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.360836    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:45.361035 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.360955    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 29 23:12:45.361035 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.360971    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 29 23:12:45.361035 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.360980    2577 projected.go:196] Error preparing data for projected volume kube-api-access-rkgfn for pod openshift-network-diagnostics/network-check-target-sd6x7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:45.361035 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.361031    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn podName:83b74d19-08b5-4303-9ce2-be9e520230a3 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:01.361014731 +0000 UTC m=+34.327652055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rkgfn" (UniqueName: "kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn") pod "network-check-target-sd6x7" (UID: "83b74d19-08b5-4303-9ce2-be9e520230a3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 29 23:12:45.567105 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.567025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:45.567226 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:45.567125    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:45.793005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.792967    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"6bd6a55612bc3da65ffbcc4aa1a91865595e03816b245beec062494b60cf28fc"}
Oct 29 23:12:45.793419 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.793041    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"fb48075fd15949fe1e5a98532f4e99c0578bfe4c93439bf2661793210cdbc8fc"}
Oct 29 23:12:45.793419 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.793079    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"904d826c17314f3e463f015d2c32be6657208696d3a322b79fd50a88370341f6"}
Oct 29 23:12:45.795906 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.795882    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" event={"ID":"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6","Type":"ContainerStarted","Data":"c39e415ed7f26f879b30f3c60e68510273c04719f90c8584dfd54934b77e5687"}
Oct 29 23:12:45.868174 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:45.868105    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wzmpl" podStartSLOduration=7.6133873659999995 podStartE2EDuration="17.868093607s" totalImagesPullingTime="10.254706241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:45.854135525 +0000 UTC m=+18.820772871" watchObservedRunningTime="2026-10-29 23:12:45.868093607 +0000 UTC m=+18.834730953"
Oct 29 23:12:46.567127 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:46.567089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:46.567321 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:46.567104    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:46.567321 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:46.567211    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:46.567321 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:46.567267    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:47.569832 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:47.569802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:47.570367 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:47.569887    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:47.802602 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:47.802569    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"ae36c96d36ccbe8a8251f62f0e4b6bac8c214fb70e68ae07a40d37960c91a073"}
Oct 29 23:12:48.567131 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:48.567098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:48.567131 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:48.567128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:48.567352 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:48.567219    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:48.567352 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:48.567334    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:49.569765 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:49.569738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:49.570344 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:49.569830    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:49.809584 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:49.809551    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" event={"ID":"87f17a44-0885-45e5-81f1-300442c926b8","Type":"ContainerStarted","Data":"c3db4ff9f82056cce0eb3af2fa5c38aec4bbcb22a132b9e4efb8f0dd59945593"}
Oct 29 23:12:49.809809 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:49.809793    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:49.824938 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:49.824751    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:49.899711 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:49.899664    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6" podStartSLOduration=7.168177239 podStartE2EDuration="21.899651549s" totalImagesPullingTime="14.73147431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:49.899146195 +0000 UTC m=+22.865783541" watchObservedRunningTime="2026-10-29 23:12:49.899651549 +0000 UTC m=+22.866288896"
Oct 29 23:12:50.567204 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:50.567176    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:50.567364 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:50.567283    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:50.567364 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:50.567310    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:50.567364 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:50.567358    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:50.812591 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:50.812550    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:50.812976 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:50.812634    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:50.828579 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:50.828497    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:12:51.156272 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:51.156198    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l4dmt"]
Oct 29 23:12:51.156495 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:51.156310    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:51.156495 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:51.156389    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:51.159473 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:51.159441    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sd6x7"]
Oct 29 23:12:51.159606 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:51.159553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:51.159679 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:51.159645    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:51.160359 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:51.160336    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpbxx"]
Oct 29 23:12:51.160463 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:51.160425    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:51.160552 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:51.160535    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:52.566992 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:52.566949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:52.566992 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:52.566981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:52.567458 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:52.567063    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:52.567458 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:52.567205    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:53.570574 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:53.570545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:53.571024 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:53.570676    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:54.566724 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:54.566690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:54.566910 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:54.566821    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:54.566910 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:54.566864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:54.567026 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:54.566947    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:55.569733 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:55.569706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:55.570111 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:55.569792    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd6x7" podUID="83b74d19-08b5-4303-9ce2-be9e520230a3"
Oct 29 23:12:56.567019 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.566992    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:56.567173 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.567026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:56.567173 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:56.567084    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-l4dmt" podUID="6cf9cc14-3177-4dc4-8f45-ab8f230d185c"
Oct 29 23:12:56.567247 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:56.567199    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dpbxx" podUID="23297409-95e7-435a-8bca-d70d93ea2c09"
Oct 29 23:12:56.842019 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.841994    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeReady"
Oct 29 23:12:56.842375 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.842098    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 29 23:12:56.894772 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.894751    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-jlxrw"]
Oct 29 23:12:56.897301 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.897285    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-25hfz"]
Oct 29 23:12:56.897399 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.897385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:12:56.900225 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.900113    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-nh9gd"]
Oct 29 23:12:56.901599 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.901581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:12:56.903081 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.903061    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-f8sqw"]
Oct 29 23:12:56.903191 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.903179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:12:56.905704 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.905683    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5d7cd8c56f-8gsnl"]
Oct 29 23:12:56.905809 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.905790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:56.908608 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.908589    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"]
Oct 29 23:12:56.908734 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.908714    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:56.912066 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.912044    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"]
Oct 29 23:12:56.912652 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.912638    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:56.915113 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.915094    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"]
Oct 29 23:12:56.915357 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.915342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:56.917651 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.917632    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 29 23:12:56.917970 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.917955    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"]
Oct 29 23:12:56.918098 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.918067    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:56.921589 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.921571    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 29 23:12:56.921676 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.921664    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"]
Oct 29 23:12:56.921779 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.921766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:56.924330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.924316    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-nd299"]
Oct 29 23:12:56.924466 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.924451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:56.927176 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.927158    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 29 23:12:56.929368 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.928025    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"]
Oct 29 23:12:56.929368 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.928210    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:56.932537 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.932519    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b87f698cd-z5z9k"]
Oct 29 23:12:56.932637 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.932627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:12:56.941355 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.941336    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"]
Oct 29 23:12:56.941787 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.941768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:56.944445 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.944428    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj"]
Oct 29 23:12:56.944603 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.944585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:12:56.948161 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.947684    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f8lst"]
Oct 29 23:12:56.948161 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.947787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:56.952718 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.952701    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vqvz7"]
Oct 29 23:12:56.952862 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.952842    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:56.956082 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956062    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-25hfz"]
Oct 29 23:12:56.956181 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956100    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-jlxrw"]
Oct 29 23:12:56.956181 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956123    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-nh9gd"]
Oct 29 23:12:56.956181 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956173    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-f8sqw"]
Oct 29 23:12:56.956426 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:56.956623 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956195    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"]
Oct 29 23:12:56.956980 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.956963    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"]
Oct 29 23:12:56.957116 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.957104    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"]
Oct 29 23:12:56.957243 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.957223    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"]
Oct 29 23:12:56.957341 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.957253    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"]
Oct 29 23:12:56.958002 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.957683    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-nd299"]
Oct 29 23:12:56.963802 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.961750    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8lst"]
Oct 29 23:12:56.963802 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.963313    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b87f698cd-z5z9k"]
Oct 29 23:12:56.963802 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.963367    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d7cd8c56f-8gsnl"]
Oct 29 23:12:56.964145 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.964128    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"]
Oct 29 23:12:56.973708 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.973683    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqvz7"]
Oct 29 23:12:56.979245 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.979223    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj"]
Oct 29 23:12:56.987578 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:56.987552    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"]
Oct 29 23:12:57.018315 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.018284    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 29 23:12:57.018414 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.018394    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 29 23:12:57.018414 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.018407    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.018820 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.018801    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.018820 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.018814    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.018931 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.018803    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.019105 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019084    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.019218 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019156    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 29 23:12:57.019279 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019269    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.019309 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019280    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.019352 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019343    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.019383 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019370    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.019417 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019389    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.019417 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019406    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.019537 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019519    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 29 23:12:57.019630 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019539    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 29 23:12:57.019630 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019346    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.019730 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019717    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.019779 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019726    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.019779 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019766    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 29 23:12:57.019874 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019810    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.019928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019869    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 29 23:12:57.019928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019890    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.020031 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019942    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.020031 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019959    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.020031 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.019981    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:12:57.020423 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.020399    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 29 23:12:57.020499 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.020402    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 29 23:12:57.047597 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.047573    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 29 23:12:57.047597 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.047591    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 29 23:12:57.047977 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.047950    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 29 23:12:57.047977 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.047951    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.047992    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048000    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048023    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048041    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048052    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048064    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048072    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048121    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048126    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-984bt\""
Oct 29 23:12:57.048140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048142    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 29 23:12:57.048607 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048151    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 29 23:12:57.048607 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048186    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 29 23:12:57.048607 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048209    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 29 23:12:57.048607 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048214    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 29 23:12:57.048607 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048370    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 29 23:12:57.048607 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048437    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dskf4\""
Oct 29 23:12:57.048872 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.048667    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h6cnq\""
Oct 29 23:12:57.050514 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67dc\" (UniqueName: \"kubernetes.io/projected/50c71f90-e5d1-41b1-a902-dec4b4df0571-kube-api-access-w67dc\") pod \"kas-connection-checker-685895c7c9-25hfz\" (UID: \"50c71f90-e5d1-41b1-a902-dec4b4df0571\") " pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:12:57.050591 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.050591 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-trusted-ca\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.050591 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m76k4\" (UniqueName: \"kubernetes.io/projected/3c078f72-3706-4f1a-8f7b-24374afa43c8-kube-api-access-m76k4\") pod \"network-check-source-6f78d59f99-s7fcp\" (UID: \"3c078f72-3706-4f1a-8f7b-24374afa43c8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:12:57.050591 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.050712 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.050712 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.050770 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050728    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-service-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.050801 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nqf4\" (UniqueName: \"kubernetes.io/projected/f2e9e89c-8edc-48b1-a494-a265cd949867-kube-api-access-9nqf4\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.050801 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050795    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ns77\" (UniqueName: \"kubernetes.io/projected/a2bd555f-4524-41ef-900a-25b26103bec8-kube-api-access-2ns77\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.050861 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.050861 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050834    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6lrz\" (UniqueName: \"kubernetes.io/projected/2299d6c8-8676-4142-8744-a6869aa852fa-kube-api-access-n6lrz\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.050913 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf8680-3179-4d73-abac-d53520204010-tmp-dir\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.050913 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2299d6c8-8676-4142-8744-a6869aa852fa-serving-cert\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.050970 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.050999 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.050988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d4lk\" (UniqueName: \"kubernetes.io/projected/d6712f77-7134-416f-b4e9-271e5ba93e30-kube-api-access-5d4lk\") pod \"kas-connection-checker-685895c7c9-nh9gd\" (UID: \"d6712f77-7134-416f-b4e9-271e5ba93e30\") " pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:12:57.051029 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-stats-auth\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.051057 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.051088 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e00a2559-ea47-4bde-9c63-a175add6c791-nginx-conf\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:57.051121 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86d517f1-0115-4d62-983c-2ad7b98ebb94-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.051150 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.051197 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.051228 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-serving-cert\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.051267 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-config\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.051300 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ebf8680-3179-4d73-abac-d53520204010-config-volume\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.051300 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp58p\" (UniqueName: \"kubernetes.io/projected/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-kube-api-access-bp58p\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.051356 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfwr4\" (UniqueName: \"kubernetes.io/projected/86d517f1-0115-4d62-983c-2ad7b98ebb94-kube-api-access-gfwr4\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.051356 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4mtp\" (UniqueName: \"kubernetes.io/projected/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-kube-api-access-n4mtp\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.051413 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmj87\" (UniqueName: \"kubernetes.io/projected/03c6b963-7075-4411-9bc1-af2a05401cde-kube-api-access-wmj87\") pod \"volume-data-source-validator-58c9f5f46d-bd4hn\" (UID: \"03c6b963-7075-4411-9bc1-af2a05401cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:12:57.051413 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s25pf\" (UniqueName: \"kubernetes.io/projected/2aa5feeb-9699-4404-83e5-17cf95e7c17e-kube-api-access-s25pf\") pod \"kas-connection-checker-685895c7c9-jlxrw\" (UID: \"2aa5feeb-9699-4404-83e5-17cf95e7c17e\") " pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:12:57.051466 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:57.051466 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd555f-4524-41ef-900a-25b26103bec8-serving-cert\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.051539 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-cert\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.051572 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051552    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-tmp\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.051602 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.051602 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.051665 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.051665 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-default-certificate\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.051724 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.051724 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.051779 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051732    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zxx2\" (UniqueName: \"kubernetes.io/projected/2ebf8680-3179-4d73-abac-d53520204010-kube-api-access-7zxx2\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.051779 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e39db65-958e-48e5-9b21-38c452e8b00f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.051839 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051778    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.051839 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.051839 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e39db65-958e-48e5-9b21-38c452e8b00f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.051918 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.051918 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.051918 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqtw9\" (UniqueName: \"kubernetes.io/projected/7f0c3a6a-b4fb-469f-9837-2f010a013a49-kube-api-access-hqtw9\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.051918 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-snapshots\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.052027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.052027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.052027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.052027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.051995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-config\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.052138 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.052029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.052138 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.052049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxn5\" (UniqueName: \"kubernetes.io/projected/1e39db65-958e-48e5-9b21-38c452e8b00f-kube-api-access-qlxn5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.052138 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.052067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.152575 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-serving-cert\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.152575 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-config\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.152792 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ebf8680-3179-4d73-abac-d53520204010-config-volume\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.152792 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152620    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp58p\" (UniqueName: \"kubernetes.io/projected/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-kube-api-access-bp58p\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.152792 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfwr4\" (UniqueName: \"kubernetes.io/projected/86d517f1-0115-4d62-983c-2ad7b98ebb94-kube-api-access-gfwr4\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.152792 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4mtp\" (UniqueName: \"kubernetes.io/projected/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-kube-api-access-n4mtp\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.152990 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmj87\" (UniqueName: \"kubernetes.io/projected/03c6b963-7075-4411-9bc1-af2a05401cde-kube-api-access-wmj87\") pod \"volume-data-source-validator-58c9f5f46d-bd4hn\" (UID: \"03c6b963-7075-4411-9bc1-af2a05401cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:12:57.152990 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.152975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s25pf\" (UniqueName: \"kubernetes.io/projected/2aa5feeb-9699-4404-83e5-17cf95e7c17e-kube-api-access-s25pf\") pod \"kas-connection-checker-685895c7c9-jlxrw\" (UID: \"2aa5feeb-9699-4404-83e5-17cf95e7c17e\") " pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:12:57.153093 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:57.153093 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd555f-4524-41ef-900a-25b26103bec8-serving-cert\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.153093 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-cert\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.153234 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-tmp\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.153234 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153600    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-config\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153658    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ebf8680-3179-4d73-abac-d53520204010-config-volume\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.153700    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.153761    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.653744911 +0000 UTC m=+30.620382256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153797    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153821    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-default-certificate\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.153828    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.153842    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799bd4bb47-g7rsj: secret "image-registry-tls" not found
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153873    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.153897    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls podName:f68b6b5d-44aa-4e94-b320-a669b4f09250 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.653881161 +0000 UTC m=+30.620518504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls") pod "image-registry-799bd4bb47-g7rsj" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250") : secret "image-registry-tls" not found
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zxx2\" (UniqueName: \"kubernetes.io/projected/2ebf8680-3179-4d73-abac-d53520204010-kube-api-access-7zxx2\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153953    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-tmp\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.153957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e39db65-958e-48e5-9b21-38c452e8b00f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.156236 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.154028    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.154040    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b87f698cd-z5z9k: secret "image-registry-tls" not found
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.154073    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls podName:99e1c2a2-3edf-450a-9de0-ec803ff28569 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.654059787 +0000 UTC m=+30.620697137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls") pod "image-registry-6b87f698cd-z5z9k" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569") : secret "image-registry-tls" not found
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e39db65-958e-48e5-9b21-38c452e8b00f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqtw9\" (UniqueName: \"kubernetes.io/projected/7f0c3a6a-b4fb-469f-9837-2f010a013a49-kube-api-access-hqtw9\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-snapshots\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-config\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxn5\" (UniqueName: \"kubernetes.io/projected/1e39db65-958e-48e5-9b21-38c452e8b00f-kube-api-access-qlxn5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.157206 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w67dc\" (UniqueName: \"kubernetes.io/projected/50c71f90-e5d1-41b1-a902-dec4b4df0571-kube-api-access-w67dc\") pod \"kas-connection-checker-685895c7c9-25hfz\" (UID: \"50c71f90-e5d1-41b1-a902-dec4b4df0571\") " pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154425    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-trusted-ca\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m76k4\" (UniqueName: \"kubernetes.io/projected/3c078f72-3706-4f1a-8f7b-24374afa43c8-kube-api-access-m76k4\") pod \"network-check-source-6f78d59f99-s7fcp\" (UID: \"3c078f72-3706-4f1a-8f7b-24374afa43c8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154517    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-service-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqf4\" (UniqueName: \"kubernetes.io/projected/f2e9e89c-8edc-48b1-a494-a265cd949867-kube-api-access-9nqf4\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154611    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ns77\" (UniqueName: \"kubernetes.io/projected/a2bd555f-4524-41ef-900a-25b26103bec8-kube-api-access-2ns77\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154661    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e39db65-958e-48e5-9b21-38c452e8b00f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6lrz\" (UniqueName: \"kubernetes.io/projected/2299d6c8-8676-4142-8744-a6869aa852fa-kube-api-access-n6lrz\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf8680-3179-4d73-abac-d53520204010-tmp-dir\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.157954 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154751    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2299d6c8-8676-4142-8744-a6869aa852fa-serving-cert\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4lk\" (UniqueName: \"kubernetes.io/projected/d6712f77-7134-416f-b4e9-271e5ba93e30-kube-api-access-5d4lk\") pod \"kas-connection-checker-685895c7c9-nh9gd\" (UID: \"d6712f77-7134-416f-b4e9-271e5ba93e30\") " pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-stats-auth\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e00a2559-ea47-4bde-9c63-a175add6c791-nginx-conf\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86d517f1-0115-4d62-983c-2ad7b98ebb94-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.154974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.155003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.155128    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.155168    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls podName:86d517f1-0115-4d62-983c-2ad7b98ebb94 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.655155756 +0000 UTC m=+30.621793107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tx897" (UID: "86d517f1-0115-4d62-983c-2ad7b98ebb94") : secret "cluster-monitoring-operator-tls" not found
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.155410    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.155703    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.155716    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-config\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.155762    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.655746522 +0000 UTC m=+30.622383847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:12:57.158790 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.155917    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.156668    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e00a2559-ea47-4bde-9c63-a175add6c791-nginx-conf\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.157233    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.157521    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86d517f1-0115-4d62-983c-2ad7b98ebb94-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.157855    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.157910    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.657897383 +0000 UTC m=+30.624534708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.157983    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.158020    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls podName:f2e9e89c-8edc-48b1-a494-a265cd949867 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.658007867 +0000 UTC m=+30.624645192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-dmlrk" (UID: "f2e9e89c-8edc-48b1-a494-a265cd949867") : secret "samples-operator-tls" not found
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.158152    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.158402    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.158418    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.158456    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-default-certificate\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.158873    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-snapshots\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.158987    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:57.658972479 +0000 UTC m=+30.625609820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.159196    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-trusted-ca\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.159616 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.159465    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-service-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.160352 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.159887    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf8680-3179-4d73-abac-d53520204010-tmp-dir\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.160352 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.159917    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-serving-cert\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.160352 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.159967    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.160352 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.160119    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd555f-4524-41ef-900a-25b26103bec8-serving-cert\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.160570 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.160461    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.160570 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.160554    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e39db65-958e-48e5-9b21-38c452e8b00f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.160681 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.160653    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2299d6c8-8676-4142-8744-a6869aa852fa-serving-cert\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.160802 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.160782    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-cert\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.161571 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.161552    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-stats-auth\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.161799 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.161773    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.162046 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.162028    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.177694 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.177668    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4mtp\" (UniqueName: \"kubernetes.io/projected/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-kube-api-access-n4mtp\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.178738 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.178714    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfwr4\" (UniqueName: \"kubernetes.io/projected/86d517f1-0115-4d62-983c-2ad7b98ebb94-kube-api-access-gfwr4\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.178815 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.178794    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s25pf\" (UniqueName: \"kubernetes.io/projected/2aa5feeb-9699-4404-83e5-17cf95e7c17e-kube-api-access-s25pf\") pod \"kas-connection-checker-685895c7c9-jlxrw\" (UID: \"2aa5feeb-9699-4404-83e5-17cf95e7c17e\") " pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:12:57.179010 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.178989    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmj87\" (UniqueName: \"kubernetes.io/projected/03c6b963-7075-4411-9bc1-af2a05401cde-kube-api-access-wmj87\") pod \"volume-data-source-validator-58c9f5f46d-bd4hn\" (UID: \"03c6b963-7075-4411-9bc1-af2a05401cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:12:57.179044 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.179026    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp58p\" (UniqueName: \"kubernetes.io/projected/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-kube-api-access-bp58p\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.179119 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.179105    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.184158 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.184137    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67dc\" (UniqueName: \"kubernetes.io/projected/50c71f90-e5d1-41b1-a902-dec4b4df0571-kube-api-access-w67dc\") pod \"kas-connection-checker-685895c7c9-25hfz\" (UID: \"50c71f90-e5d1-41b1-a902-dec4b4df0571\") " pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:12:57.184252 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.184207    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.185244 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.185221    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ns77\" (UniqueName: \"kubernetes.io/projected/a2bd555f-4524-41ef-900a-25b26103bec8-kube-api-access-2ns77\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.185951    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqf4\" (UniqueName: \"kubernetes.io/projected/f2e9e89c-8edc-48b1-a494-a265cd949867-kube-api-access-9nqf4\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.185971    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqtw9\" (UniqueName: \"kubernetes.io/projected/7f0c3a6a-b4fb-469f-9837-2f010a013a49-kube-api-access-hqtw9\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.185993    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.186025    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxn5\" (UniqueName: \"kubernetes.io/projected/1e39db65-958e-48e5-9b21-38c452e8b00f-kube-api-access-qlxn5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.186344    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zxx2\" (UniqueName: \"kubernetes.io/projected/2ebf8680-3179-4d73-abac-d53520204010-kube-api-access-7zxx2\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.186389    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4lk\" (UniqueName: \"kubernetes.io/projected/d6712f77-7134-416f-b4e9-271e5ba93e30-kube-api-access-5d4lk\") pod \"kas-connection-checker-685895c7c9-nh9gd\" (UID: \"d6712f77-7134-416f-b4e9-271e5ba93e30\") " pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.186723    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.187222    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76k4\" (UniqueName: \"kubernetes.io/projected/3c078f72-3706-4f1a-8f7b-24374afa43c8-kube-api-access-m76k4\") pod \"network-check-source-6f78d59f99-s7fcp\" (UID: \"3c078f72-3706-4f1a-8f7b-24374afa43c8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:12:57.188008 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.187469    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6lrz\" (UniqueName: \"kubernetes.io/projected/2299d6c8-8676-4142-8744-a6869aa852fa-kube-api-access-n6lrz\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.211384 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.211365    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:12:57.220396 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.220241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:12:57.230155 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.230132    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:12:57.239159 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.239124    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:12:57.273208 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.273175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:12:57.287950 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.287771    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:12:57.295346 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.295316    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:12:57.302029 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.302002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:12:57.311657 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.311519    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:12:57.331015 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.330822    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:12:57.430023 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.428770    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:12:57.535443 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.535419    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-25hfz"]
Oct 29 23:12:57.536074 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:57.536047    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c71f90_e5d1_41b1_a902_dec4b4df0571.slice/crio-a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9 WatchSource:0}: Error finding container a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9: Status 404 returned error can't find the container with id a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9
Oct 29 23:12:57.538471 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.538447    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-jlxrw"]
Oct 29 23:12:57.538797 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:57.538780    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa5feeb_9699_4404_83e5_17cf95e7c17e.slice/crio-f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e WatchSource:0}: Error finding container f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e: Status 404 returned error can't find the container with id f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e
Oct 29 23:12:57.566651 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.566627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:12:57.582946 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.582911    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\""
Oct 29 23:12:57.588417 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.588342    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-nh9gd"]
Oct 29 23:12:57.593301 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.593277    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-f8sqw"]
Oct 29 23:12:57.615312 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.615090    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"]
Oct 29 23:12:57.618360 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:57.618301    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791d6e15_ebf3_4d7a_b4d2_c5d11b17c173.slice/crio-9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058 WatchSource:0}: Error finding container 9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058: Status 404 returned error can't find the container with id 9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058
Oct 29 23:12:57.626342 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.626294    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660539    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.660778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.660922    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.660904887 +0000 UTC m=+31.627542231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661278    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661332    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls podName:86d517f1-0115-4d62-983c-2ad7b98ebb94 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.661317281 +0000 UTC m=+31.627954622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tx897" (UID: "86d517f1-0115-4d62-983c-2ad7b98ebb94") : secret "cluster-monitoring-operator-tls" not found
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661389    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661422    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.661412272 +0000 UTC m=+31.628049610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661514    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:12:57.661928 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661526    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799bd4bb47-g7rsj: secret "image-registry-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661557    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls podName:f68b6b5d-44aa-4e94-b320-a669b4f09250 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.661546738 +0000 UTC m=+31.628184076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls") pod "image-registry-799bd4bb47-g7rsj" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250") : secret "image-registry-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661611    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661620    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b87f698cd-z5z9k: secret "image-registry-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661650    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls podName:99e1c2a2-3edf-450a-9de0-ec803ff28569 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.661638277 +0000 UTC m=+31.628275619 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls") pod "image-registry-6b87f698cd-z5z9k" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569") : secret "image-registry-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661704    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661736    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls podName:f2e9e89c-8edc-48b1-a494-a265cd949867 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.66172651 +0000 UTC m=+31.628363850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-dmlrk" (UID: "f2e9e89c-8edc-48b1-a494-a265cd949867") : secret "samples-operator-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661786    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661814    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.661805158 +0000 UTC m=+31.628442495 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661865    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:12:57.662710 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:57.661893    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:12:58.661883765 +0000 UTC m=+31.628521104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:12:57.672115 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.670858    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"]
Oct 29 23:12:57.682304 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.682239    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-nd299"]
Oct 29 23:12:57.688394 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.688277    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"]
Oct 29 23:12:57.689286 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.689260    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"]
Oct 29 23:12:57.695925 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:57.695895    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c078f72_3706_4f1a_8f7b_24374afa43c8.slice/crio-738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742 WatchSource:0}: Error finding container 738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742: Status 404 returned error can't find the container with id 738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742
Oct 29 23:12:57.706507 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.706407    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vqvz7"]
Oct 29 23:12:57.712638 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:12:57.712617    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d008fa_a5ed_4811_8ed3_ba9193e7eff6.slice/crio-4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977 WatchSource:0}: Error finding container 4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977: Status 404 returned error can't find the container with id 4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977
Oct 29 23:12:57.828410 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.828381    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp" event={"ID":"3c078f72-3706-4f1a-8f7b-24374afa43c8","Type":"ContainerStarted","Data":"738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742"}
Oct 29 23:12:57.829505 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.829487    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2" event={"ID":"1e39db65-958e-48e5-9b21-38c452e8b00f","Type":"ContainerStarted","Data":"6f5e3a12ce080497d7ef963ad13868c301642ecd957f8f3852010b006e0cfc81"}
Oct 29 23:12:57.830672 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.830654    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z" event={"ID":"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173","Type":"ContainerStarted","Data":"9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058"}
Oct 29 23:12:57.831752 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.831734    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn" event={"ID":"03c6b963-7075-4411-9bc1-af2a05401cde","Type":"ContainerStarted","Data":"036b470534928861109285297ae12ba0ee15aaca5c9c425bd4cf5acd23fcd984"}
Oct 29 23:12:57.832758 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.832728    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" event={"ID":"a2bd555f-4524-41ef-900a-25b26103bec8","Type":"ContainerStarted","Data":"44b17eb68ecc1adcdb0ea4143853d1c94a6b7f5b41583ffcf5437c3cfdfe3003"}
Oct 29 23:12:57.833846 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.833821    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-f8sqw" event={"ID":"2299d6c8-8676-4142-8744-a6869aa852fa","Type":"ContainerStarted","Data":"ecad68c0faf6cae120e46702e0a3705a3c6820739ebd255cacb569bfead1aa9f"}
Oct 29 23:12:57.835165 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.835140    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-25hfz" event={"ID":"50c71f90-e5d1-41b1-a902-dec4b4df0571","Type":"ContainerStarted","Data":"827c9c4a7e7cc13e6c523158218de189f9814be1600de1a911438a82b62810fe"}
Oct 29 23:12:57.835273 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.835171    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-25hfz" event={"ID":"50c71f90-e5d1-41b1-a902-dec4b4df0571","Type":"ContainerStarted","Data":"a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9"}
Oct 29 23:12:57.836324 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.836306    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqvz7" event={"ID":"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6","Type":"ContainerStarted","Data":"4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977"}
Oct 29 23:12:57.837640 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.837620    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-nh9gd" event={"ID":"d6712f77-7134-416f-b4e9-271e5ba93e30","Type":"ContainerStarted","Data":"498a43ba2e1b51889b06def18eb2b8b781af399afcf6114389b5110457cf5001"}
Oct 29 23:12:57.837735 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.837655    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-nh9gd" event={"ID":"d6712f77-7134-416f-b4e9-271e5ba93e30","Type":"ContainerStarted","Data":"5339f59eddd5cba10644904871582c265e63c3acb6a48809216fa87fe8d6dc4f"}
Oct 29 23:12:57.838924 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.838902    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-jlxrw" event={"ID":"2aa5feeb-9699-4404-83e5-17cf95e7c17e","Type":"ContainerStarted","Data":"f25d269bc56cc2e185b9a69b9de796619af2aeadb361414f5a2b5612b4a98930"}
Oct 29 23:12:57.838996 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.838941    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-jlxrw" event={"ID":"2aa5feeb-9699-4404-83e5-17cf95e7c17e","Type":"ContainerStarted","Data":"f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e"}
Oct 29 23:12:57.866384 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.866360    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:12:57.877328 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.877266    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-25hfz" podStartSLOduration=1737.877249404 podStartE2EDuration="28m57.877249404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:57.876713122 +0000 UTC m=+30.843350470" watchObservedRunningTime="2026-10-29 23:12:57.877249404 +0000 UTC m=+30.843886752"
Oct 29 23:12:57.917282 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:57.917243    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-nh9gd" podStartSLOduration=1737.917233014 podStartE2EDuration="28m57.917233014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:57.916919154 +0000 UTC m=+30.883556501" watchObservedRunningTime="2026-10-29 23:12:57.917233014 +0000 UTC m=+30.883870356"
Oct 29 23:12:58.001140 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.001110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:12:58.567909 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.567165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:12:58.567909 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.567206    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:12:58.584536 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.584510    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\""
Oct 29 23:12:58.584783 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.584581    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 29 23:12:58.584783 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.584688    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 29 23:12:58.584925 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.584801    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\""
Oct 29 23:12:58.670150 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:12:58.670150 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:12:58.670327 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:12:58.670327 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:58.670327 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:12:58.670327 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:12:58.670539 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670367    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:12:58.670539 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.670410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:12:58.670641 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.670579    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:12:58.670641 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.670637    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.670619056 +0000 UTC m=+33.637256394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:12:58.670999 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.670983    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:12:58.671070 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671003    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799bd4bb47-g7rsj: secret "image-registry-tls" not found
Oct 29 23:12:58.671070 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671038    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls podName:f68b6b5d-44aa-4e94-b320-a669b4f09250 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.671028502 +0000 UTC m=+33.637665839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls") pod "image-registry-799bd4bb47-g7rsj" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250") : secret "image-registry-tls" not found
Oct 29 23:12:58.671177 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671087    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:12:58.671177 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671094    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b87f698cd-z5z9k: secret "image-registry-tls" not found
Oct 29 23:12:58.671177 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671115    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls podName:99e1c2a2-3edf-450a-9de0-ec803ff28569 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.67110836 +0000 UTC m=+33.637745684 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls") pod "image-registry-6b87f698cd-z5z9k" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569") : secret "image-registry-tls" not found
Oct 29 23:12:58.671177 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671152    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 29 23:12:58.671177 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671170    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls podName:f2e9e89c-8edc-48b1-a494-a265cd949867 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.67116524 +0000 UTC m=+33.637802576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-dmlrk" (UID: "f2e9e89c-8edc-48b1-a494-a265cd949867") : secret "samples-operator-tls" not found
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671201    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671219    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.671213156 +0000 UTC m=+33.637850493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671261    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671277    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.671272463 +0000 UTC m=+33.637909800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671316    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.671311374 +0000 UTC m=+33.637948711 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671349    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 29 23:12:58.671422 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:12:58.671375    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls podName:86d517f1-0115-4d62-983c-2ad7b98ebb94 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:00.671369565 +0000 UTC m=+33.638006903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tx897" (UID: "86d517f1-0115-4d62-983c-2ad7b98ebb94") : secret "cluster-monitoring-operator-tls" not found
Oct 29 23:12:58.807929 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:58.807876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:12:59.842556 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:59.842457    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:12:59.852126 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:59.852090    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn" event={"ID":"03c6b963-7075-4411-9bc1-af2a05401cde","Type":"ContainerStarted","Data":"2124345188bc88bef5c4a5c2c32ef5d4f99064ee8aed7e738564ec7f030e2fdf"}
Oct 29 23:12:59.893407 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:59.893354    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn" podStartSLOduration=1707.976246703 podStartE2EDuration="28m29.893340349s" totalImagesPullingTime="1.917093646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:59.892721888 +0000 UTC m=+32.859359236" watchObservedRunningTime="2026-10-29 23:12:59.893340349 +0000 UTC m=+32.859977736"
Oct 29 23:12:59.893705 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:59.893679    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-jlxrw" podStartSLOduration=1739.893673638 podStartE2EDuration="28m59.893673638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:12:57.96212468 +0000 UTC m=+30.928762026" watchObservedRunningTime="2026-10-29 23:12:59.893673638 +0000 UTC m=+32.860310983"
Oct 29 23:12:59.994122 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:12:59.994079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:00.146151 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.146068    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692499    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692545    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:00.692732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.692868    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.692928    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.692909729 +0000 UTC m=+37.659547056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693371    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693354112 +0000 UTC m=+37.659991437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693452    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693528    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls podName:86d517f1-0115-4d62-983c-2ad7b98ebb94 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693491359 +0000 UTC m=+37.660128702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tx897" (UID: "86d517f1-0115-4d62-983c-2ad7b98ebb94") : secret "cluster-monitoring-operator-tls" not found
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693584    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:13:00.694005 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693616    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693605727 +0000 UTC m=+37.660243056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693676    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693687    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799bd4bb47-g7rsj: secret "image-registry-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693716    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls podName:f68b6b5d-44aa-4e94-b320-a669b4f09250 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693707425 +0000 UTC m=+37.660344751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls") pod "image-registry-799bd4bb47-g7rsj" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250") : secret "image-registry-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693767    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693777    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b87f698cd-z5z9k: secret "image-registry-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693801    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls podName:99e1c2a2-3edf-450a-9de0-ec803ff28569 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693792391 +0000 UTC m=+37.660429714 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls") pod "image-registry-6b87f698cd-z5z9k" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569") : secret "image-registry-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693854    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693883    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls podName:f2e9e89c-8edc-48b1-a494-a265cd949867 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693874607 +0000 UTC m=+37.660511931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-dmlrk" (UID: "f2e9e89c-8edc-48b1-a494-a265cd949867") : secret "samples-operator-tls" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693935    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:13:00.694847 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:00.693963    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.693954227 +0000 UTC m=+37.660591552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:13:01.300508 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.299841    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:01.300508 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.299894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:01.300508 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:01.300453    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 29 23:13:01.301412 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:01.301133    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs podName:23297409-95e7-435a-8bca-d70d93ea2c09 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:33.301108092 +0000 UTC m=+66.267745420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs") pod "network-metrics-daemon-dpbxx" (UID: "23297409-95e7-435a-8bca-d70d93ea2c09") : secret "metrics-daemon-secret" not found
Oct 29 23:13:01.307241 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.307218    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:01.346637 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.346605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:01.401564 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.401523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:01.404824 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.404770    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:01.483213 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.483182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:01.656811 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.656687    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-l4dmt"]
Oct 29 23:13:01.685055 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:13:01.685005    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf9cc14_3177_4dc4_8f45_ab8f230d185c.slice/crio-66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76 WatchSource:0}: Error finding container 66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76: Status 404 returned error can't find the container with id 66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76
Oct 29 23:13:01.804345 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.804318    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sd6x7"]
Oct 29 23:13:01.805207 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:13:01.805175    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b74d19_08b5_4303_9ce2_be9e520230a3.slice/crio-47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7 WatchSource:0}: Error finding container 47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7: Status 404 returned error can't find the container with id 47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7
Oct 29 23:13:01.860596 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.860556    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-f8sqw" event={"ID":"2299d6c8-8676-4142-8744-a6869aa852fa","Type":"ContainerStarted","Data":"2560d35aaecee9fa82d24bb36d0dc3a195e9d03f4143c2b89401a55f648be156"}
Oct 29 23:13:01.863636 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.863063    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/0.log"
Oct 29 23:13:01.863636 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.863091    2577 generic.go:356] "Generic (PLEG): container finished" podID="a2bd555f-4524-41ef-900a-25b26103bec8" containerID="743400a7a5a2bd05ae9c711eb29fee1a20fa3b26ffb4167bacd5d5d4ad5908ed" exitCode=255
Oct 29 23:13:01.863636 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.863143    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" event={"ID":"a2bd555f-4524-41ef-900a-25b26103bec8","Type":"ContainerDied","Data":"743400a7a5a2bd05ae9c711eb29fee1a20fa3b26ffb4167bacd5d5d4ad5908ed"}
Oct 29 23:13:01.863636 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.863370    2577 scope.go:122] "RemoveContainer" containerID="743400a7a5a2bd05ae9c711eb29fee1a20fa3b26ffb4167bacd5d5d4ad5908ed"
Oct 29 23:13:01.865214 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.865147    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sd6x7" event={"ID":"83b74d19-08b5-4303-9ce2-be9e520230a3","Type":"ContainerStarted","Data":"47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7"}
Oct 29 23:13:01.866653 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.866614    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-l4dmt" event={"ID":"6cf9cc14-3177-4dc4-8f45-ab8f230d185c","Type":"ContainerStarted","Data":"66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76"}
Oct 29 23:13:01.903930 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:01.903868    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-f8sqw" podStartSLOduration=1708.801823715 podStartE2EDuration="28m32.903849155s" totalImagesPullingTime="4.10202544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:01.902799583 +0000 UTC m=+34.869436930" watchObservedRunningTime="2026-10-29 23:13:01.903849155 +0000 UTC m=+34.870486504"
Oct 29 23:13:02.552262 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.552233    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sgk28"]
Oct 29 23:13:02.576303 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.576264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.581592 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.581438    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sgk28"]
Oct 29 23:13:02.592671 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.592603    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 29 23:13:02.592671 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.592610    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 29 23:13:02.592671 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.592647    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crphw\""
Oct 29 23:13:02.609188 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.609160    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-79nrp-sxknn"]
Oct 29 23:13:02.627346 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.627318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.633417 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.633391    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-79nrp-sxknn"]
Oct 29 23:13:02.673043 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.673003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:02.693460 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.693435    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sr9lt\""
Oct 29 23:13:02.714870 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.714802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.715000 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.714887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.715000 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.714916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c228562a-e001-4c95-b864-719d90ae903f-data-volume\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.715000 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.714949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.715000 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.714984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.715204 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.715015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.715204 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.715037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.715204 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.715106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c228562a-e001-4c95-b864-719d90ae903f-crio-socket\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.715204 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.715136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ss8k\" (UniqueName: \"kubernetes.io/projected/c228562a-e001-4c95-b864-719d90ae903f-kube-api-access-2ss8k\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.811574 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.810676    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:02.815721 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.815698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.815841 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.815725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c228562a-e001-4c95-b864-719d90ae903f-data-volume\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.815841 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.815764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.815922 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:02.815865    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:02.815956 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:02.815934    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:03.315915281 +0000 UTC m=+36.282552608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:02.816010 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.815991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.816044 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.816092 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.816173 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c228562a-e001-4c95-b864-719d90ae903f-crio-socket\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.816214 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816200    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.816258 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ss8k\" (UniqueName: \"kubernetes.io/projected/c228562a-e001-4c95-b864-719d90ae903f-kube-api-access-2ss8k\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.816289 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.816336 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:02.816325    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:02.816374 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:02.816363    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:03.316350849 +0000 UTC m=+36.282988186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:02.816664 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816649    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c228562a-e001-4c95-b864-719d90ae903f-data-volume\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.816878 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816858    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c228562a-e001-4c95-b864-719d90ae903f-crio-socket\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.816946 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.816901    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.817336 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.817312    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.840302 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.840276    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ss8k\" (UniqueName: \"kubernetes.io/projected/c228562a-e001-4c95-b864-719d90ae903f-kube-api-access-2ss8k\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:02.841182 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.841125    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:02.873040 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.872959    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2" event={"ID":"1e39db65-958e-48e5-9b21-38c452e8b00f","Type":"ContainerStarted","Data":"c183e49039b6daa67a984d3d2fb56fcb1a2b09a7b1dcb48f3fca5ddbfd2369c8"}
Oct 29 23:13:02.877807 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.877777    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z" event={"ID":"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173","Type":"ContainerStarted","Data":"0e5f974c2465d423a2e8e9a382ad912f5c9206c159604ca140b4d7e93e4a72e8"}
Oct 29 23:13:02.880649 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.880624    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/1.log"
Oct 29 23:13:02.881058 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.881039    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/0.log"
Oct 29 23:13:02.881142 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.881076    2577 generic.go:356] "Generic (PLEG): container finished" podID="a2bd555f-4524-41ef-900a-25b26103bec8" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d" exitCode=255
Oct 29 23:13:02.881180 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.881153    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" event={"ID":"a2bd555f-4524-41ef-900a-25b26103bec8","Type":"ContainerDied","Data":"8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d"}
Oct 29 23:13:02.881214 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.881206    2577 scope.go:122] "RemoveContainer" containerID="743400a7a5a2bd05ae9c711eb29fee1a20fa3b26ffb4167bacd5d5d4ad5908ed"
Oct 29 23:13:02.881519 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.881498    2577 scope.go:122] "RemoveContainer" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d"
Oct 29 23:13:02.881702 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:02.881682    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-nd299_openshift-console-operator(a2bd555f-4524-41ef-900a-25b26103bec8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" podUID="a2bd555f-4524-41ef-900a-25b26103bec8"
Oct 29 23:13:02.915345 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.915296    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2" podStartSLOduration=1708.152379641 podStartE2EDuration="28m32.915278734s" totalImagesPullingTime="4.762899093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:02.914924477 +0000 UTC m=+35.881561824" watchObservedRunningTime="2026-10-29 23:13:02.915278734 +0000 UTC m=+35.881916089"
Oct 29 23:13:02.957183 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:02.957014    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:03.005472 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.003922    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z" podStartSLOduration=1709.181661906 podStartE2EDuration="28m34.003902989s" totalImagesPullingTime="4.822241083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:03.003263566 +0000 UTC m=+35.969900907" watchObservedRunningTime="2026-10-29 23:13:03.003902989 +0000 UTC m=+35.970540338"
Oct 29 23:13:03.233512 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.233393    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:03.304982 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.304955    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-79nrp-sxknn"]
Oct 29 23:13:03.306801 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:13:03.306745    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod572f6f60_a6cb_4498_ada7_94531d16c807.slice/crio-0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae WatchSource:0}: Error finding container 0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae: Status 404 returned error can't find the container with id 0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae
Oct 29 23:13:03.327330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.326970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:03.327330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.327051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:03.327330 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:03.327060    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:03.327330 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:03.327120    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.327100837 +0000 UTC m=+37.293738174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:03.327330 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:03.327188    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:03.327330 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:03.327240    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:04.327224795 +0000 UTC m=+37.293862131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:03.395582 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.395547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:03.749388 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.748533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:03.840129 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.840094    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"]
Oct 29 23:13:03.866459 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.866328    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"]
Oct 29 23:13:03.866646 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.866558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:03.882338 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.882306    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"]
Oct 29 23:13:03.882504 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.882354    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"]
Oct 29 23:13:03.882504 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.882409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:03.892951 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.892920    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7rwfl\""
Oct 29 23:13:03.897174 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.897149    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/1.log"
Oct 29 23:13:03.897611 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.897591    2577 scope.go:122] "RemoveContainer" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d"
Oct 29 23:13:03.897915 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:03.897813    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-nd299_openshift-console-operator(a2bd555f-4524-41ef-900a-25b26103bec8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" podUID="a2bd555f-4524-41ef-900a-25b26103bec8"
Oct 29 23:13:03.917457 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.917419    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:03.917649 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.917554    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 29 23:13:03.918810 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.918715    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-79nrp-sxknn" event={"ID":"572f6f60-a6cb-4498-ada7-94531d16c807","Type":"ContainerStarted","Data":"81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9"}
Oct 29 23:13:03.918810 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.918769    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-79nrp-sxknn" event={"ID":"572f6f60-a6cb-4498-ada7-94531d16c807","Type":"ContainerStarted","Data":"0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae"}
Oct 29 23:13:03.921696 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.921647    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vqvz7" event={"ID":"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6","Type":"ContainerStarted","Data":"61af9cbd6c14e602e1ffe593983a582d87c8e74270101261b8f04ed6f94a435d"}
Oct 29 23:13:03.943453 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.935613    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp" event={"ID":"3c078f72-3706-4f1a-8f7b-24374afa43c8","Type":"ContainerStarted","Data":"4175f06297ae5212771592186be087b794d3bbce89d72f83e906bd6209e3e791"}
Oct 29 23:13:03.964294 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.964258    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:03.975262 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:03.975208    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vqvz7" podStartSLOduration=2.811466323 podStartE2EDuration="7.975194309s" totalImagesPullingTime="5.163727986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:03.973746597 +0000 UTC m=+36.940383944" watchObservedRunningTime="2026-10-29 23:13:03.975194309 +0000 UTC m=+36.941831686"
Oct 29 23:13:04.025440 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.024774    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-79nrp-sxknn" podStartSLOduration=2.024752992 podStartE2EDuration="2.024752992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:04.023782509 +0000 UTC m=+36.990419860" watchObservedRunningTime="2026-10-29 23:13:04.024752992 +0000 UTC m=+36.991390339"
Oct 29 23:13:04.038029 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.035895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgwc9\" (UniqueName: \"kubernetes.io/projected/ce3bfe21-b153-4b04-95ce-68f8d3da6f07-kube-api-access-hgwc9\") pod \"migrator-66df5d496b-z92qb\" (UID: \"ce3bfe21-b153-4b04-95ce-68f8d3da6f07\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:04.038029 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.036068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gw2g\" (UniqueName: \"kubernetes.io/projected/55857705-54d1-4c50-89bc-ba0ea23d2fe0-kube-api-access-7gw2g\") pod \"migrator-66df5d496b-xzbjc\" (UID: \"55857705-54d1-4c50-89bc-ba0ea23d2fe0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:04.137572 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.137518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwc9\" (UniqueName: \"kubernetes.io/projected/ce3bfe21-b153-4b04-95ce-68f8d3da6f07-kube-api-access-hgwc9\") pod \"migrator-66df5d496b-z92qb\" (UID: \"ce3bfe21-b153-4b04-95ce-68f8d3da6f07\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:04.137731 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.137604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gw2g\" (UniqueName: \"kubernetes.io/projected/55857705-54d1-4c50-89bc-ba0ea23d2fe0-kube-api-access-7gw2g\") pod \"migrator-66df5d496b-xzbjc\" (UID: \"55857705-54d1-4c50-89bc-ba0ea23d2fe0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:04.149209 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.149162    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:04.159632 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.159600    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gw2g\" (UniqueName: \"kubernetes.io/projected/55857705-54d1-4c50-89bc-ba0ea23d2fe0-kube-api-access-7gw2g\") pod \"migrator-66df5d496b-xzbjc\" (UID: \"55857705-54d1-4c50-89bc-ba0ea23d2fe0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:04.161319 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.161291    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwc9\" (UniqueName: \"kubernetes.io/projected/ce3bfe21-b153-4b04-95ce-68f8d3da6f07-kube-api-access-hgwc9\") pod \"migrator-66df5d496b-z92qb\" (UID: \"ce3bfe21-b153-4b04-95ce-68f8d3da6f07\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:04.164660 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.164613    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp" podStartSLOduration=1708.538339992 podStartE2EDuration="28m34.164595882s" totalImagesPullingTime="5.62625589s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 22:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:04.16364283 +0000 UTC m=+37.130280193" watchObservedRunningTime="2026-10-29 23:13:04.164595882 +0000 UTC m=+37.131233231"
Oct 29 23:13:04.195060 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.195029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:04.219549 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.219524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:04.249106 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.249077    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6brzf"]
Oct 29 23:13:04.279254 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.278560    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6brzf"]
Oct 29 23:13:04.279254 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.278665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.297330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.295643    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 29 23:13:04.297330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.296336    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 29 23:13:04.297330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.296433    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b2b7x\""
Oct 29 23:13:04.297330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.296530    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 29 23:13:04.297330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.296640    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 29 23:13:04.340110 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.340082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:04.340245 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.340144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:04.340302 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.340288    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:04.340362 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.340352    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:06.340332473 +0000 UTC m=+39.306969799 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:04.340707 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.340685    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:04.340830 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.340736    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:06.34072275 +0000 UTC m=+39.307360078 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:04.441306 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.441266    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnlqd\" (UniqueName: \"kubernetes.io/projected/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-kube-api-access-hnlqd\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.441686 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.441658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-key\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.441837 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.441701    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-cabundle\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.527688 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.525530    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"]
Oct 29 23:13:04.543027 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.542995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-key\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.543156 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.543044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-cabundle\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.543156 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.543092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnlqd\" (UniqueName: \"kubernetes.io/projected/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-kube-api-access-hnlqd\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.544566 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.544541    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-cabundle\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.546554 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.546529    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-key\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.556141 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.556118    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"]
Oct 29 23:13:04.556729 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:13:04.556700    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55857705_54d1_4c50_89bc_ba0ea23d2fe0.slice/crio-2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c WatchSource:0}: Error finding container 2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c: Status 404 returned error can't find the container with id 2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c
Oct 29 23:13:04.565851 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.565822    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnlqd\" (UniqueName: \"kubernetes.io/projected/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-kube-api-access-hnlqd\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.615253 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.615215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:04.744786 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.744744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:04.744961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.744817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:04.744961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.744863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:04.744961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.744896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:04.744961 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.744923    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 29 23:13:04.744961 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.744950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.744972    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.744994    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-799bd4bb47-g7rsj: secret "image-registry-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745000    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls podName:86d517f1-0115-4d62-983c-2ad7b98ebb94 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.744978952 +0000 UTC m=+45.711616295 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-tx897" (UID: "86d517f1-0115-4d62-983c-2ad7b98ebb94") : secret "cluster-monitoring-operator-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745021    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745045    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls podName:f68b6b5d-44aa-4e94-b320-a669b4f09250 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745027744 +0000 UTC m=+45.711665087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls") pod "image-registry-799bd4bb47-g7rsj" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250") : secret "image-registry-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.744977    2577 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745064    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls podName:f2e9e89c-8edc-48b1-a494-a265cd949867 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745053717 +0000 UTC m=+45.711691041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-dmlrk" (UID: "f2e9e89c-8edc-48b1-a494-a265cd949867") : secret "samples-operator-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745066    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.744977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745081    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b87f698cd-z5z9k: secret "image-registry-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745090    2577 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745099    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745084656 +0000 UTC m=+45.711721980 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745123    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745112762 +0000 UTC m=+45.711750109 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745139    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls podName:99e1c2a2-3edf-450a-9de0-ec803ff28569 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745133739 +0000 UTC m=+45.711771066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls") pod "image-registry-6b87f698cd-z5z9k" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569") : secret "image-registry-tls" not found
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.745161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:04.745218 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.745189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:04.745820 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745230    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:13:04.745820 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745268    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745256503 +0000 UTC m=+45.711893866 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:13:04.745820 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:04.745281    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:12.745274803 +0000 UTC m=+45.711912166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:13:04.933270 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.933244    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6brzf"]
Oct 29 23:13:04.934975 ip-10-0-134-8 kubenswrapper[2577]: W1029 23:13:04.934946    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f3ddb5_dfff_4606_84c8_8bb5ba8aef4b.slice/crio-0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83 WatchSource:0}: Error finding container 0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83: Status 404 returned error can't find the container with id 0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83
Oct 29 23:13:04.940404 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.940379    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc" event={"ID":"55857705-54d1-4c50-89bc-ba0ea23d2fe0","Type":"ContainerStarted","Data":"2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c"}
Oct 29 23:13:04.941711 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.941689    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb" event={"ID":"ce3bfe21-b153-4b04-95ce-68f8d3da6f07","Type":"ContainerStarted","Data":"784df82499e3c63abf0c4113ba4f77fd16586ca00b0d2b3993361381a5d884c7"}
Oct 29 23:13:04.945069 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:04.945044    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf" event={"ID":"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b","Type":"ContainerStarted","Data":"0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83"}
Oct 29 23:13:05.643860 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:05.643748    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:05.831836 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:05.831800    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:05.950704 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:05.950632    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sd6x7" event={"ID":"83b74d19-08b5-4303-9ce2-be9e520230a3","Type":"ContainerStarted","Data":"4f4de1124d78b5f473a9bbeb3bbd5cc2165cf171facbe9d4db12cbe56e1a5d97"}
Oct 29 23:13:05.951077 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:05.950721    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:05.953065 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:05.953041    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf" event={"ID":"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b","Type":"ContainerStarted","Data":"cbadc1e2eba44068723f9ef0a84007930fd2e1db094110a2ad898c74a574d836"}
Oct 29 23:13:06.007435 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.007385    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sd6x7" podStartSLOduration=34.939487107 podStartE2EDuration="38.007372751s" totalImagesPullingTime="3.067885644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:06.006448098 +0000 UTC m=+38.973085446" watchObservedRunningTime="2026-10-29 23:13:06.007372751 +0000 UTC m=+38.974010119"
Oct 29 23:13:06.051830 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.051779    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf" podStartSLOduration=2.051766006 podStartE2EDuration="2.051766006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:06.050226083 +0000 UTC m=+39.016863430" watchObservedRunningTime="2026-10-29 23:13:06.051766006 +0000 UTC m=+39.018403351"
Oct 29 23:13:06.285939 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.285889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:06.366190 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.366160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:06.366345 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.366229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:06.366345 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:06.366263    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:06.366345 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:06.366333    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.366315803 +0000 UTC m=+43.332953147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:06.366532 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:06.366395    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:06.366532 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:06.366436    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.36642327 +0000 UTC m=+43.333060611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:06.434330 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.434304    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw2vc_2e00bed0-7bc2-4322-b108-efb74a2ee6cd/dns-node-resolver/0.log"
Oct 29 23:13:06.441905 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.441881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:06.608316 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.608278    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:06.760836 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.760741    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:06.958052 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.957958    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc" event={"ID":"55857705-54d1-4c50-89bc-ba0ea23d2fe0","Type":"ContainerStarted","Data":"28fc71047c2da6034a9f8701962390090e84292022542b3563ef210e28bbe3f1"}
Oct 29 23:13:06.959957 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:06.959916    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb" event={"ID":"ce3bfe21-b153-4b04-95ce-68f8d3da6f07","Type":"ContainerStarted","Data":"5424e40d4bc3d7907a2359276e56370ac4101d33551b380f0e36bb50910dd471"}
Oct 29 23:13:07.002704 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.002644    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc" podStartSLOduration=2.134533298 podStartE2EDuration="4.002625616s" totalImagesPullingTime="1.868092318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:07.002015769 +0000 UTC m=+39.968653112" watchObservedRunningTime="2026-10-29 23:13:07.002625616 +0000 UTC m=+39.969262965"
Oct 29 23:13:07.046513 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.045539    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb" podStartSLOduration=2.319754103 podStartE2EDuration="4.045512355s" totalImagesPullingTime="1.725758252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:07.045331487 +0000 UTC m=+40.011968834" watchObservedRunningTime="2026-10-29 23:13:07.045512355 +0000 UTC m=+40.012149701"
Oct 29 23:13:07.298290 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.298252    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:07.298511 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.298352    2577 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:07.298811 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.298793    2577 scope.go:122] "RemoveContainer" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d"
Oct 29 23:13:07.299039 ip-10-0-134-8 kubenswrapper[2577]: E1029 23:13:07.299010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-nd299_openshift-console-operator(a2bd555f-4524-41ef-900a-25b26103bec8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" podUID="a2bd555f-4524-41ef-900a-25b26103bec8"
Oct 29 23:13:07.640692 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.640617    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qcbhg_8e4d414a-b040-4e77-9ddf-a37d04677415/node-ca/0.log"
Oct 29 23:13:07.783404 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:07.783354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:08.034688 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.034663    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqvz7_b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/serve-healthcheck-canary/0.log"
Oct 29 23:13:08.125277 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.125242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:08.238703 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.238663    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-xzbjc_55857705-54d1-4c50-89bc-ba0ea23d2fe0/migrator/0.log"
Oct 29 23:13:08.420979 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.420940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:08.437134 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.437110    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-z92qb_ce3bfe21-b153-4b04-95ce-68f8d3da6f07/migrator/0.log"
Oct 29 23:13:08.585177 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.585088    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:08.626972 ip-10-0-134-8 kubenswrapper[2577]: I1029 23:13:08.626857    2577 dynamic_cafile_content.go:175] "Shutting down controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 29 23:13:08.627025 ip-10-0-134-8 systemd[1]: Stopping Kubernetes Kubelet...
Oct 29 23:13:08.640933 ip-10-0-134-8 systemd[1]: kubelet.service: Deactivated successfully.
Oct 29 23:13:08.641176 ip-10-0-134-8 systemd[1]: Stopped Kubernetes Kubelet.
Oct 29 23:13:08.641242 ip-10-0-134-8 systemd[1]: kubelet.service: Consumed 3.210s CPU time.
Oct 29 23:13:08.658119 ip-10-0-134-8 systemd[1]: Starting Kubernetes Kubelet...
Oct 29 23:13:08.728366 ip-10-0-134-8 kubenswrapper[5044]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 29 23:13:08.728366 ip-10-0-134-8 kubenswrapper[5044]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 29 23:13:08.728366 ip-10-0-134-8 kubenswrapper[5044]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 29 23:13:08.728366 ip-10-0-134-8 kubenswrapper[5044]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 29 23:13:08.730379 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730296    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.730379 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730380    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730384    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730387    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730390    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730393    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730396    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730399    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730401    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730404    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730406    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730410    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730413    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730416    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730418    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730421    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730423    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730426    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730429    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730431    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730433    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.730448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730436    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730439    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730441    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730444    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730446    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730456    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730459    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730463    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730466    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730468    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730471    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730488    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730493    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730497    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730501    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730505    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730509    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730513    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730517    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.730977 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730521    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730524    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730527    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730530    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730532    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730535    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730537    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730540    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730543    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730545    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730548    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730550    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730554    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730557    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730560    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730563    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730565    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730568    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730571    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.731448 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730574    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730577    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730579    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730582    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730585    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730587    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730590    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730592    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730595    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730597    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730602    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730606    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730612    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730616    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730619    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730622    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730625    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730628    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730631    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.731959 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730634    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730636    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730639    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730642    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730644    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730647    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730653    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730655    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730658    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730661    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730664    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730666    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730669    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730672    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730675    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730678    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730680    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730683    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730686    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.732436 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730688    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730691    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730694    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730696    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730699    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730701    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730704    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730707    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.730715    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731531    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731538    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731541    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731544    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731547    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731550    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731552    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731556    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731559    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731562    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731567    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.732908 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731570    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731572    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731575    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731578    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731580    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731583    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731586    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731588    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731591    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731594    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731597    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731599    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731602    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731604    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731607    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731610    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731613    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731615    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731618    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731620    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.733435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731623    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731625    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731628    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731630    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731633    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731636    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731640    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731643    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731646    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731649    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731651    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731655    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731658    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731670    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731673    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731676    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731679    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731681    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731684    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731687    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.733991 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731689    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731693    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731696    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731699    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731702    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731704    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731707    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731709    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731712    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731715    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731719    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731723    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731726    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731729    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731732    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731734    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731737    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731740    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731743    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.734501 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731746    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731749    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731752    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731754    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731758    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731761    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731764    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731766    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731769    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731771    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731774    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731776    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731779    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731781    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731784    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731789    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731793    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731796    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731799    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.735013 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731802    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731805    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731808    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731811    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731813    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731816    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731818    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731821    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731824    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731826    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731829    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731831    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731835    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731837    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731840    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731843    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.731845    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732318    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732322    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.735499 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732325    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732330    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732333    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732336    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732339    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732342    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732345    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732348    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732350    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732353    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732356    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732359    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732361    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732364    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732366    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732369    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732371    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732375    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732377    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.735978 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732380    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732382    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732385    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732388    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732390    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732394    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732401    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732404    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732407    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732409    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732412    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732415    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732418    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732420    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732423    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732425    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732428    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732430    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732433    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732435    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.736788 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732438    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732441    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732443    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732446    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732449    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732452    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732455    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732457    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732459    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732462    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732465    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732467    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732470    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732473    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732488    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732491    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732494    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732497    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732501    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732503    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.737687 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732506    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732508    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732511    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732514    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732516    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732519    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732522    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732524    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732527    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732529    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732532    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732534    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732537    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732540    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732542    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732545    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732548    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732551    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732554    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.738578 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732556    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732559    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732562    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732565    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732567    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732570    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732573    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732575    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732578    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732580    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732583    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732586    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732589    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732591    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732594    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732596    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732599    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732601    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732604    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.739407 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732606    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732610    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732613    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732615    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732617    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732620    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.732622    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732711    5044 flags.go:64] FLAG: --address="0.0.0.0"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732718    5044 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732725    5044 flags.go:64] FLAG: --anonymous-auth="true"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732732    5044 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732739    5044 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732743    5044 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732748    5044 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732752    5044 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732755    5044 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732758    5044 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732762    5044 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732765    5044 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732768    5044 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732771    5044 flags.go:64] FLAG: --cgroup-root=""
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732774    5044 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732777    5044 flags.go:64] FLAG: --client-ca-file=""
Oct 29 23:13:08.740037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732780    5044 flags.go:64] FLAG: --cloud-provider="external"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732785    5044 flags.go:64] FLAG: --cluster-dns="[]"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732789    5044 flags.go:64] FLAG: --cluster-domain=""
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732792    5044 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732795    5044 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732798    5044 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732802    5044 flags.go:64] FLAG: --container-log-max-files="5"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732806    5044 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732809    5044 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732812    5044 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732815    5044 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732818    5044 flags.go:64] FLAG: --contention-profiling="false"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732822    5044 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732824    5044 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732828    5044 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732831    5044 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732835    5044 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732839    5044 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732842    5044 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732845    5044 flags.go:64] FLAG: --enable-load-reader="false"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732848    5044 flags.go:64] FLAG: --enable-server="true"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732855    5044 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732860    5044 flags.go:64] FLAG: --event-burst="100"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732863    5044 flags.go:64] FLAG: --event-qps="50"
Oct 29 23:13:08.740859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732866    5044 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732871    5044 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732874    5044 flags.go:64] FLAG: --eviction-hard=""
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732878    5044 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732881    5044 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732884    5044 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732887    5044 flags.go:64] FLAG: --eviction-soft=""
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732890    5044 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732894    5044 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732898    5044 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732901    5044 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732904    5044 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732907    5044 flags.go:64] FLAG: --fail-swap-on="true"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732910    5044 flags.go:64] FLAG: --feature-gates=""
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732914    5044 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732918    5044 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732921    5044 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732925    5044 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732928    5044 flags.go:64] FLAG: --healthz-port="10248"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732932    5044 flags.go:64] FLAG: --help="false"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732934    5044 flags.go:64] FLAG: --hostname-override="ip-10-0-134-8.ec2.internal"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732937    5044 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732940    5044 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 29 23:13:08.741444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732947    5044 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732950    5044 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732954    5044 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732957    5044 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732960    5044 flags.go:64] FLAG: --image-service-endpoint=""
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732963    5044 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732966    5044 flags.go:64] FLAG: --kube-api-burst="100"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732970    5044 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732973    5044 flags.go:64] FLAG: --kube-api-qps="50"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732976    5044 flags.go:64] FLAG: --kube-reserved=""
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732980    5044 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732983    5044 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732987    5044 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732990    5044 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732992    5044 flags.go:64] FLAG: --lock-file=""
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732995    5044 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.732998    5044 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733001    5044 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733007    5044 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733011    5044 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733016    5044 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733021    5044 flags.go:64] FLAG: --logging-format="text"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733025    5044 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733031    5044 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 29 23:13:08.742053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733035    5044 flags.go:64] FLAG: --manifest-url=""
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733040    5044 flags.go:64] FLAG: --manifest-url-header=""
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733045    5044 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733048    5044 flags.go:64] FLAG: --max-open-files="1000000"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733052    5044 flags.go:64] FLAG: --max-pods="110"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733055    5044 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733058    5044 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733061    5044 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733064    5044 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733067    5044 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733071    5044 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733074    5044 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733081    5044 flags.go:64] FLAG: --node-status-max-images="50"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733084    5044 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733087    5044 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733090    5044 flags.go:64] FLAG: --pod-cidr=""
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733094    5044 flags.go:64] FLAG: --pod-manifest-path=""
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733097    5044 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733101    5044 flags.go:64] FLAG: --pods-per-core="0"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733104    5044 flags.go:64] FLAG: --port="10250"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733107    5044 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733110    5044 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-018abf08465cf5a72"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733113    5044 flags.go:64] FLAG: --qos-reserved=""
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733116    5044 flags.go:64] FLAG: --read-only-port="10255"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733119    5044 flags.go:64] FLAG: --register-node="true"
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733122    5044 flags.go:64] FLAG: --register-with-taints=""
Oct 29 23:13:08.742653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733126    5044 flags.go:64] FLAG: --registry-burst="10"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733129    5044 flags.go:64] FLAG: --registry-qps="5"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733131    5044 flags.go:64] FLAG: --reserved-cpus=""
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733134    5044 flags.go:64] FLAG: --reserved-memory=""
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733138    5044 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733141    5044 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733144    5044 flags.go:64] FLAG: --rotate-certificates="false"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733147    5044 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733150    5044 flags.go:64] FLAG: --runonce="false"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733153    5044 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733156    5044 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733159    5044 flags.go:64] FLAG: --seccomp-default="false"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733162    5044 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733165    5044 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733168    5044 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733171    5044 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733174    5044 flags.go:64] FLAG: --storage-driver-password="root"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733176    5044 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733179    5044 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733182    5044 flags.go:64] FLAG: --storage-driver-user="root"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733185    5044 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733188    5044 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733191    5044 flags.go:64] FLAG: --system-cgroups=""
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733194    5044 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733200    5044 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 29 23:13:08.743430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733203    5044 flags.go:64] FLAG: --tls-cert-file=""
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733206    5044 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733210    5044 flags.go:64] FLAG: --tls-min-version=""
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733213    5044 flags.go:64] FLAG: --tls-private-key-file=""
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733216    5044 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733219    5044 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733222    5044 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733225    5044 flags.go:64] FLAG: --v="2"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733229    5044 flags.go:64] FLAG: --version="false"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733233    5044 flags.go:64] FLAG: --vmodule=""
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733237    5044 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733241    5044 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733377    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733380    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733384    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733387    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733390    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733393    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733395    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733398    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733401    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733403    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.744094 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733406    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733409    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733411    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733414    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733416    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733419    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733421    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733424    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733426    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733432    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733435    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733441    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733445    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733448    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733451    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733454    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733457    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733460    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733462    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.744835 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733465    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733468    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733470    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733473    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733487    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733489    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733492    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733495    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733497    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733501    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733503    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733506    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733509    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733511    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733515    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733519    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733522    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733525    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733528    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.745446 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733530    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733533    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733536    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733540    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733543    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733547    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733550    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733552    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733555    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733557    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733560    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733563    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733565    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733568    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733571    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733573    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733576    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733578    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733581    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733584    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.746027 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733586    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733589    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733592    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733595    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733597    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733600    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733602    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733605    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733607    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733610    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733612    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733615    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733617    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733620    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733622    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733626    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733629    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733633    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733636    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733638    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.746604 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733641    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733644    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733646    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733649    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733652    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733654    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733657    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733659    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733662    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733664    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733667    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733670    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733672    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733675    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733677    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733680    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733683    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.747088 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733685    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.733712    5044 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733749    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733753    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733756    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733760    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733763    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733766    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733769    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733772    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733776    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733778    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733781    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733786    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733789    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733791    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.747556 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733794    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733797    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733799    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733802    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733805    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733807    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733810    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733812    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733815    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733817    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733820    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733822    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733825    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733828    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733830    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733833    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733835    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733838    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733840    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733843    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.748046 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733846    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733848    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733851    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733854    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733856    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733859    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733863    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733866    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733869    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733873    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733876    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733879    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733881    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733884    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733887    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733889    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733892    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733894    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733897    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733900    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.748622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733902    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733905    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733907    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733910    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733912    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733915    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733917    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733920    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733923    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733925    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733928    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733930    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733933    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733935    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733938    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733942    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733945    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733948    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733952    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.749128 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733955    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733957    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733961    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733964    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733967    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733969    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733972    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733975    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733978    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733980    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733982    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733985    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733988    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733990    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733993    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733996    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.733999    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734002    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734004    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.749647 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734007    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734011    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734014    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734018    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734020    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734023    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734025    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734028    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734030    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734033    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734036    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734039    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734043    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.734046    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.739132    5044 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.739153    5044 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.739179    5044 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.739187    5044 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739586    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.750120 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739909    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739915    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739919    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739924    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739929    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739934    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739939    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739944    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739949    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739953    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739965    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739969    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739974    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739978    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739983    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739988    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739992    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.739997    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740001    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740007    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.750609 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740011    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740016    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740021    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740030    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740034    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740039    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740043    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740048    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740084    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740090    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740095    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740100    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740104    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740109    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740113    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740125    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740131    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740137    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740142    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740146    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.751257 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740150    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740155    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740160    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740165    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740170    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740174    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740179    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740183    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740193    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740197    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740202    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740207    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740212    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740216    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740221    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740225    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740230    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740234    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740238    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.751759 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740243    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740248    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740285    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740291    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740296    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740300    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740305    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740309    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740314    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740319    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740323    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740328    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740333    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740337    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740347    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740352    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740356    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740361    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740365    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740369    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.752230 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740374    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740381    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740387    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740393    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740398    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740402    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740407    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740417    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740422    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740461    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740503    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740511    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740518    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740538    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740544    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740548    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740551    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740554    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740705    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.752733 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740720    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740724    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740727    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740730    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740734    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740737    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740740    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.740777    5044 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740922    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740926    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740929    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740932    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740935    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740938    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740941    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740944    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.753192 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740947    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740949    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740951    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740955    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740958    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740960    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740963    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740966    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740968    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740971    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740974    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740977    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740980    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740983    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740986    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740988    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740991    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740995    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.740998    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.753793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741000    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741003    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741006    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741009    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741011    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741014    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741016    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741019    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741021    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741024    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741027    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741031    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741036    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741039    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741043    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741045    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741048    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741051    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.754265 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741053    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741056    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741060    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741063    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741066    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741069    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741072    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741074    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741078    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741081    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741084    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741086    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741090    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741093    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741096    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741098    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741101    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741103    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741106    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.754720 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741108    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741111    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741114    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741116    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741119    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741121    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741124    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741127    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741132    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741135    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741137    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741149    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741152    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741174    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741178    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741180    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741183    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741186    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741188    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741191    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.755227 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741193    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741196    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741198    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741201    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741204    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741208    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741210    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741213    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741216    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741218    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741221    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741223    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741226    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741228    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741231    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741234    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741237    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741239    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741242    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741244    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.755746 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741248    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741251    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.741274    5044 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741304    5044 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741315    5044 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741319    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741322    5044 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741325    5044 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741327    5044 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741330    5044 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741333    5044 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741336    5044 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741339    5044 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741341    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741344    5044 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741347    5044 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 29 23:13:08.756434 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741349    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741352    5044 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741357    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741360    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741363    5044 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741365    5044 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741368    5044 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741371    5044 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741373    5044 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741376    5044 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741378    5044 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741381    5044 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741383    5044 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741386    5044 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741389    5044 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741391    5044 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741395    5044 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741398    5044 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741400    5044 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 29 23:13:08.757140 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741403    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741406    5044 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741414    5044 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741417    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741420    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741422    5044 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741425    5044 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741428    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741430    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741433    5044 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741438    5044 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741441    5044 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741444    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741447    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741450    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741454    5044 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741457    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741459    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 29 23:13:08.757983 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741462    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741466    5044 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741469    5044 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741472    5044 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741490    5044 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741494    5044 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741498    5044 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741501    5044 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741503    5044 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741506    5044 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741508    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741512    5044 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741515    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741517    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741520    5044 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741522    5044 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741525    5044 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741536    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741539    5044 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 29 23:13:08.758832 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741541    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741544    5044 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741547    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741549    5044 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741552    5044 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741554    5044 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741557    5044 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741559    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741562    5044 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741564    5044 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741567    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741570    5044 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741572    5044 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741575    5044 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741577    5044 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741580    5044 feature_gate.go:386] unrecognized feature gate: Example
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741582    5044 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741585    5044 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741587    5044 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741590    5044 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 29 23:13:08.759776 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741593    5044 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741595    5044 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741598    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741600    5044 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741604    5044 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741607    5044 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741610    5044 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741612    5044 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741615    5044 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741618    5044 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741620    5044 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741628    5044 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741631    5044 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741634    5044 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741637    5044 feature_gate.go:386] unrecognized feature gate: Example2
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741640    5044 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:08.741643    5044 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.741734    5044 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.742732    5044 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.742783    5044 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 29 23:13:08.760640 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.742966    5044 server.go:1014] "Starting client certificate rotation"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.743126    5044 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.743198    5044 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-28 23:07:28 +0000 UTC" deadline="2028-08-07 11:14:28.52923125 +0000 UTC"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.743238    5044 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15540h1m19.785997016s"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.743514    5044 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.744596    5044 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.745868    5044 log.go:25] "Validated CRI v1 runtime API"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.747551    5044 log.go:25] "Validated CRI v1 image API"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.748255    5044 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 29 23:13:08.761516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.750238    5044 fs.go:135] Filesystem UUIDs: map[33ddb0c0-06ba-48df-a54e-e5bd8b54f2d9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9f501e45-79a3-4302-8385-64678565ed3d:/dev/nvme0n1p3]
Oct 29 23:13:08.761813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.750257    5044 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/036b470534928861109285297ae12ba0ee15aaca5c9c425bd4cf5acd23fcd984/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/036b470534928861109285297ae12ba0ee15aaca5c9c425bd4cf5acd23fcd984/userdata/shm major:0 minor:241 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83/userdata/shm major:0 minor:356 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c/userdata/shm major:0 minor:348 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/44b17eb68ecc1adcdb0ea4143853d1c94a6b7f5b41583ffcf5437c3cfdfe3003/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/44b17eb68ecc1adcdb0ea4143853d1c94a6b7f5b41583ffcf5437c3cfdfe3003/userdata/shm major:0 minor:240 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5339f59eddd5cba10644904871582c265e63c3acb6a48809216fa87fe8d6dc4f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5339f59eddd5cba10644904871582c265e63c3acb6a48809216fa87fe8d6dc4f/userdata/shm major:0 minor:232 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76/userdata/shm major:0 minor:293 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6f5e3a12ce080497d7ef963ad13868c301642ecd957f8f3852010b006e0cfc81/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6f5e3a12ce080497d7ef963ad13868c301642ecd957f8f3852010b006e0cfc81/userdata/shm major:0 minor:238 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742/userdata/shm major:0 minor:244 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/784df82499e3c63abf0c4113ba4f77fd16586ca00b0d2b3993361381a5d884c7/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/784df82499e3c63abf0c4113ba4f77fd16586ca00b0d2b3993361381a5d884c7/userdata/shm major:0 minor:346 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058/userdata/shm major:0 minor:236 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9/userdata/shm major:0 minor:230 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec/userdata/shm major:0 minor:88 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c131273c1d9f389895b2bdff961edf059a8de053b0be7373939c87d1d3b0740d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c131273c1d9f389895b2bdff961edf059a8de053b0be7373939c87d1d3b0740d/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ecad68c0faf6cae120e46702e0a3705a3c6820739ebd255cacb569bfead1aa9f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ecad68c0faf6cae120e46702e0a3705a3c6820739ebd255cacb569bfead1aa9f/userdata/shm major:0 minor:234 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e/userdata/shm major:0 minor:228 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/03c6b963-7075-4411-9bc1-af2a05401cde/volumes/kubernetes.io~projected/kube-api-access-wmj87:{mountpoint:/var/lib/kubelet/pods/03c6b963-7075-4411-9bc1-af2a05401cde/volumes/kubernetes.io~projected/kube-api-access-wmj87 major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~projected/kube-api-access-4px82:{mountpoint:/var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~projected/kube-api-access-4px82 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/131528b2-b2fe-4d0d-9260-db245d108396/volumes/kubernetes.io~projected/kube-api-access-s7rsg:{mountpoint:/var/lib/kubelet/pods/131528b2-b2fe-4d0d-9260-db245d108396/volumes/kubernetes.io~projected/kube-api-access-s7rsg major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e39db65-958e-48e5-9b21-38c452e8b00f/volumes/kubernetes.io~projected/kube-api-access-qlxn5:{mountpoint:/var/lib/kubelet/pods/1e39db65-958e-48e5-9b21-38c452e8b00f/volumes/kubernetes.io~projected/kube-api-access-qlxn5 major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e39db65-958e-48e5-9b21-38c452e8b00f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/1e39db65-958e-48e5-9b21-38c452e8b00f/volumes/kubernetes.io~secret/serving-cert major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2299d6c8-8676-4142-8744-a6869aa852fa/volumes/kubernetes.io~projected/kube-api-access-n6lrz:{mountpoint:/var/lib/kubelet/pods/2299d6c8-8676-4142-8744-a6869aa852fa/volumes/kubernetes.io~projected/kube-api-access-n6lrz major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2299d6c8-8676-4142-8744-a6869aa852fa/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/2299d6c8-8676-4142-8744-a6869aa852fa/volumes/kubernetes.io~secret/serving-cert major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/23297409-95e7-435a-8bca-d70d93ea2c09/volumes/kubernetes.io~projected/kube-api-access-nxx7s:{mountpoint:/var/lib/kubelet/pods/23297409-95e7-435a-8bca-d70d93ea2c09/volumes/kubernetes.io~projected/kube-api-access-nxx7s major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2aa5feeb-9699-4404-83e5-17cf95e7c17e/volumes/kubernetes.io~projected/kube-api-access-s25pf:{mountpoint:/var/lib/kubelet/pods/2aa5feeb-9699-4404-83e5-17cf95e7c17e/volumes/kubernetes.io~projected/kube-api-access-s25pf major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2e00bed0-7bc2-4322-b108-efb74a2ee6cd/volumes/kubernetes.io~projected/kube-api-access-5j9z8:{mountpoint:/var/lib/kubelet/pods/2e00bed0-7bc2-4322-b108-efb74a2ee6cd/volumes/kubernetes.io~projected/kube-api-access-5j9z8 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2ebf8680-3179-4d73-abac-d53520204010/volumes/kubernetes.io~projected/kube-api-access-7zxx2:{mountpoint:/var/lib/kubelet/pods/2ebf8680-3179-4d73-abac-d53520204010/volumes/kubernetes.io~projected/kube-api-access-7zxx2 major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3c078f72-3706-4f1a-8f7b-24374afa43c8/volumes/kubernetes.io~projected/kube-api-access-m76k4:{mountpoint:/var/lib/kubelet/pods/3c078f72-3706-4f1a-8f7b-24374afa43c8/volumes/kubernetes.io~projected/kube-api-access-m76k4 major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50c71f90-e5d1-41b1-a902-dec4b4df0571/volumes/kubernetes.io~projected/kube-api-access-w67dc:{mountpoint:/var/lib/kubelet/pods/50c71f90-e5d1-41b1-a902-dec4b4df0571/volumes/kubernetes.io~projected/kube-api-access-w67dc major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/55857705-54d1-4c50-89bc-ba0ea23d2fe0/volumes/kubernetes.io~projected/kube-api-access-7gw2g:{mountpoint:/var/lib/kubelet/pods/55857705-54d1-4c50-89bc-ba0ea23d2fe0/volumes/kubernetes.io~projected/kube-api-access-7gw2g major:0 minor:337 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/572f6f60-a6cb-4498-ada7-94531d16c807/volumes/kubernetes.io~projected/kube-api-access-wb4gk:{mountpoint:/var/lib/kubelet/pods/572f6f60-a6cb-4498-ada7-94531d16c807/volumes/kubernetes.io~projected/kube-api-access-wb4gk major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a83a964-ea7b-449e-8473-6677bf54e3b0/volumes/kubernetes.io~projected/kube-api-access-j2dcl:{mountpoint:/var/lib/kubelet/pods/5a83a964-ea7b-449e-8473-6677bf54e3b0/volumes/kubernetes.io~projected/kube-api-access-j2dcl major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6cf9cc14-3177-4dc4-8f45-ab8f230d185c/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/6cf9cc14-3177-4dc4-8f45-ab8f230d185c/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173/volumes/kubernetes.io~projected/kube-api-access-n4mtp:{mountpoint:/var/lib/kubelet/pods/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173/volumes/kubernetes.io~projected/kube-api-access-n4mtp major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~projected/kube-api-access-hqtw9:{mountpoint:/var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~projected/kube-api-access-hqtw9 major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~secret/default-certificate major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~secret/stats-auth major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/83b74d19-08b5-4303-9ce2-be9e520230a3/volumes/kubernetes.io~projected/kube-api-access-rkgfn:{mountpoint:/var/lib/kubelet/pods/83b74d19-08b5-4303-9ce2-be9e520230a3/volumes/kubernetes.io~projected/kube-api-access-rkgfn major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/86d517f1-0115-4d62-983c-2ad7b98ebb94/volumes/kubernetes.io~projected/kube-api-access-gfwr4:{mountpoint:/var/lib/kubelet/pods/86d517f1-0115-4d62-983c-2ad7b98ebb94/volumes/kubernetes.io~projected/kube-api-access-gfwr4 major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volumes/kubernetes.io~projected/kube-api-access-49qtk:{mountpoint:/var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volumes/kubernetes.io~projected/kube-api-access-49qtk major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8e4d414a-b040-4e77-9ddf-a37d04677415/volumes/kubernetes.io~projected/kube-api-access-7wrl4:{mountpoint:/var/lib/kubelet/pods/8e4d414a-b040-4e77-9ddf-a37d04677415/volumes/kubernetes.io~projected/kube-api-access-7wrl4 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b/volumes/kubernetes.io~projected/kube-api-access-hnlqd:{mountpoint:/var/lib/kubelet/pods/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b/volumes/kubernetes.io~projected/kube-api-access-hnlqd major:0 minor:355 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b/volumes/kubernetes.io~secret/signing-key major:0 minor:352 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~projected/kube-api-access-5m6gf:{mountpoint:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~projected/kube-api-access-5m6gf major:0 minor:214 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6/volumes/kubernetes.io~projected/kube-api-access-sdtwq:{mountpoint:/var/lib/kubelet/pods/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6/volumes/kubernetes.io~projected/kube-api-access-sdtwq major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a2bd555f-4524-41ef-900a-25b26103bec8/volumes/kubernetes.io~projected/kube-api-access-2ns77:{mountpoint:/var/lib/kubelet/pods/a2bd555f-4524-41ef-900a-25b26103bec8/volumes/kubernetes.io~projected/kube-api-access-2ns77 major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a2bd555f-4524-41ef-900a-25b26103bec8/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/a2bd555f-4524-41ef-900a-25b26103bec8/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a3b6629b-dbda-44d0-8f3e-7e3d52f84632/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/a3b6629b-dbda-44d0-8f3e-7e3d52f84632/volumes/kubernetes.io~secret/agent-certs major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/volumes/kubernetes.io~projected/kube-api-access-bp58p:{mountpoint:/var/lib/kubelet/pods/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/volumes/kubernetes.io~projected/kube-api-access-bp58p major:0 minor:215 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/volumes/kubernetes.io~secret/cert major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c228562a-e001-4c95-b864-719d90ae903f/volumes/kubernetes.io~projected/kube-api-access-2ss8k:{mountpoint:/var/lib/kubelet/pods/c228562a-e001-4c95-b864-719d90ae903f/volumes/kubernetes.io~projected/kube-api-access-2ss8k major:0 minor:313 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ce3bfe21-b153-4b04-95ce-68f8d3da6f07/volumes/kubernetes.io~projected/kube-api-access-hgwc9:{mountpoint:/var/lib/kubelet/pods/ce3bfe21-b153-4b04-95ce-68f8d3da6f07/volumes/kubernetes.io~projected/kube-api-access-hgwc9 major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d6712f77-7134-416f-b4e9-271e5ba93e30/volumes/kubernetes.io~projected/kube-api-access-5d4lk:{mountpoint:/var/lib/kubelet/pods/d6712f77-7134-416f-b4e9-271e5ba93e30/volumes/kubernetes.io~projected/kube-api-access-5d4lk major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9874f42-2ba3-4eba-af65-a6f114fcaaf6/volumes/kubernetes.io~projected/kube-api-access-ppptf:{mountpoint:/var/lib/kubelet/pods/e9874f42-2ba3-4eba-af65-a6f114fcaaf6/volumes/kubernetes.io~projected/kube-api-access-ppptf major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2e9e89c-8edc-48b1-a494-a265cd949867/volumes/kubernetes.io~projected/kube-api-access-9nqf4:{mountpoint:/var/lib/kubelet/pods/f2e9e89c-8edc-48b1-a494-a265cd949867/volumes/kubernetes.io~projected/kube-api-access-9nqf4 major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~projected/kube-api-access-kkpw5:{mountpoint:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~projected/kube-api-access-kkpw5 major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:208 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/9ea3e3f90eda3dba2b050df5a73730a04a0a89c7bc9470bff383cd9d5fa6f75d/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/91a3cabf5a30051973b3fa9e837564f911f0eb52858af5ebdeeaddfd02f82c40/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/81bdf383169b4b0537802dbd84364efdb432d785a907174a3ccb10f855044c2d/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/1b43d85161a0bcaa4df3d059311ffabcf7c79f152025a3f7e87e8f6f0f11ebd4/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/2801573113b256b6c82b79a0c4a54c39f50d3f4813e51160332e88f1a188e748/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/6bb2a0028d7eb93e312104828e9837a21f3b5a8074238ee161896ec8b751af83/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/47010a618e426a065fc1e82120cea234ebe102d622d38b5aa62b3fef5bdeef19/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/371754326c8ada34eebb9f54534b06d553a6f30222808380d243dc4b8ae41774/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/7384baeba4fcd57ef2338428e9759d9e15cbbdeff4e765c4016151c6a67dc3ea/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-137:{mountpoint:/var/lib/containers/storage/overlay/4edd183ca9a88a86ffb281e9de3cc2c640422c0f2daa5d89b044dca2199a727b/merged major:0 minor:137 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/e024d37c73ff0e142ffcce3429c9a9f9f5c398119d627196fc340daec6bffbbf/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/be4faca400e575600ef16e582f05b0277f6349602607c31508287fc475cfe357/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/4a1c7da16f786bb4eacaeed340c4a26dc182574b5bd87d183da244929b65eb3d/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/cfeff74f8a0aedbc019231baa840d6d66db54c2733ba48d9727079dc8ae2cfae/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/0f7010255ec23faaca68b9ac8f62882a558bd006498646d230523b3d2eb53960/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/ce5f21369ccc1e51ca1ff2272de379472ce92c46a5c80f067954574212688ca9/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/1913546e3f01ce643b0b4c9624ea73a5b3f6d8848d9409ab67d09c5170372fd7/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-176:{mountpoint:/var/lib/containers/storage/overlay/4aaee5c2273d64f15eb8e0284a48d60d8bfbfd0f7035b08a98b2705a6e19f730/merged major:0 minor:176 fsType:overlay blockSize:0} overlay_0-179:{mountpoint:/var/lib/containers/storage/overlay/4a9818eb61bf955ec633020c62a9f37ef8baa851ae64ee18080657ad7caf42b3/merged major:0 minor:179 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/830e7addf79b5e57c30fa11c86fba909473e8f2e6d76ae3dcd3c115c7ad73093/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/c4895e46a33568497cce2407a8bc9e87ff1d3b1859bc0f09995ae63cf899bb0a/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/af516ec770a32622a56332f5f278802c30c5011764043234b1e038e026cc0dca/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/b119882d2ed5d485cfb3d8230c730e5a477bdf9f7a0a6fb954a440fbc3f01ac1/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/b49efe9cfd90abecb2fe94bdc29a2e44781d63a362bc7378314ae4a03127cb9d/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/9ba1af7ab6b6250e506109857644ff76ad29e4066207cc5007e015d48120669d/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/fd53af7984d7d7baf69f430b382d3d39813eb2f7f25adddc684c13118d545521/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/1dbdf76623ca5e5fd3060ed01eb4749d42d276d9b4b8995b030fd7ac102a9783/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/baf226d415b17a615de91b32059c021bb3c8baa139d2275f879e17a187e96426/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/8048779fec86de71aa7d8eb5804be9222252eaa52038c85ad20522c6da89166a/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-264:{mountpoint:/var/lib/containers/storage/overlay/97d43140cd629b679677146b70b8a557a7196ad73b7fab038149e01d0ed4d2a1/merged major:0 minor:264 fsType:overlay blockSize:0} overlay_0-265:{mountpoint:/var/lib/containers/storage/overlay/94008ff23c3082a5dca798746d860f9b20da64f54e6d497e1d383c52dd99c4a9/merged major:0 minor:265 fsType:overlay blockSize:0} overlay_0-274:{mountpoint:/var/lib/containers/storage/overlay/32df6f3fda9c68d1ebaaeb53e48ec64292cc08205de45e2f232a127340dbc1fe/merged major:0 minor:274 fsType:overlay blockSize:0} overlay_0-276:{mountpoint:/var/lib/containers/storage/overlay/fc26bb5a33e71abdabf354f6616420ddddfe07b776e8db9de15c0bd99f7519db/merged major:0 minor:276 fsType:overlay blockSize:0} overlay_0-280:{mountpoint:/var/lib/containers/storage/overlay/94662b5781f19a86bf9e350afc187f3a9b51e357fd0828c2feb93f1d6cdacfc7/merged major:0 minor:280 fsType:overlay blockSize:0} overlay_0-281:{mountpoint:/var/lib/containers/storage/overlay/e23b6e6736f4b1c999438dd35c0af11d27ad11064785611900f3174b427f35e1/merged major:0 minor:281 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/1d5daf67d0a30bdc138f4feffb697332f761b460d46efebd3be1511eba8b8ec4/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/6c49501d0c67f37eb0e59121a228fb9c85c442dcfaa98da47b410c23af0a4b6e/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/ce243483ec5587e480611ebdaaa89dc77c3f9e7e3834a2aacdd0509bf907050b/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-307:{mountpoint:/var/lib/containers/storage/overlay/f241728a52d69b9a09f54b66b6f4e4ec1ae0c4863f4f1efedfa8229063ae72d9/merged major:0 minor:307 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/72ae95f88060dc54ab7a84d8be89aea110912148643013c50cf50a3e5037a82b/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-322:{mountpoint:/var/lib/containers/storage/overlay/47e8db8b491dc038324018acd57e73eaf3eed3157a3d0fedd3d6c618d32f538d/merged major:0 minor:322 fsType:overlay blockSize:0} overlay_0-330:{mountpoint:/var/lib/containers/storage/overlay/dae3e58b789b65ea11e0ea4a881f7995b27b88d3431cdb05f3116119964e681a/merged major:0 minor:330 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/f8e2c9e90eec918fffb253bcdd9f2b1f71fae72b4951ade185726eba75a7752d/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/46448e9b06c613054528b0879ee5a0322acf0c0ab7921f799886feb3e3583caf/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-350:{mountpoint:/var/lib/containers/storage/overlay/92e5ebdcf1a8ceead3f837c2fcaa27264e310224e9b8079ca44ad6f717cc54b3/merged major:0 minor:350 fsType:overlay blockSize:0} overlay_0-353:{mountpoint:/var/lib/containers/storage/overlay/46bfd5b2f431d607566dfc0796f372d115cfecd1c1ef180ea4de4ecc45e0dfbc/merged major:0 minor:353 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/23b800af49f65eb2707231762dd8fbc5a62d9e11bd19c77f885dbf4ab54a8167/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/186dfa8c5ce383530ca34472b413047ac05081fde62d6842e149163905c59502/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/68f7698e641252a5268af783dc47d264913b09eaa64ff11336fb1e68be9c1def/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/d564930dbf4fb3e724e6f63d0a504f724c4eea797fc36ea8944da9b10a17002a/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/90cb569dbf3bbc8fb2a1baba2cff2dbe2b17c1d665f9bfd6ed306c7ec3510363/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-380:{mountpoint:/var/lib/containers/storage/overlay/535e5e774467ee80153f5d11089b466a4a309a0afcf1edbe74d9e24cd278e6f1/merged major:0 minor:380 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/43930935d91f490cbaef613d0daa73befdd862ae23e1441dc810006b992eca76/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/7be4e6b696f1024eca144d931514c9cfe605cbbc14eb2d7d39f8a28a75677eba/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/fd6a69c829409928c64e7c66dc9706cbb0f9b1c5f0b9b2009c8e4a80c6d69f17/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/14db56e4a658f232eff8e061b83c16c65d1f954c9d3fea1bd14d4ab979f5efa0/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-77:{mountpoint:/var/lib/containers/storage/overlay/13355f2c441ef01d64fe1f40c144c760d684ef1972a3a43e6ca4ceb329802dfd/merged major:0 minor:77 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/a7cde8b9389873055835fa27f729fbcb68d0317cf3eb99d55d88d556c91c389f/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/cba1efa21d898201aaa7e2038094729e8d0f0228148ecbedff2aaaf9d6e63b73/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-89:{mountpoint:/var/lib/containers/storage/overlay/98a933ca084912c716f4dbbf892ee6f8512081d9ce14ebf8a89a224a2fa70ac7/merged major:0 minor:89 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/d986a0ede1ab109cdb7c0eba9d3b021fd604ded9e950f5fa1b5928a870fc8bc4/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/57bc8589491927043de69ef7c7ff24970f8b87f05181cf227c991df9b7b944cb/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.760725    5044 manager.go:217] Machine: {Timestamp:2026-10-29 23:13:08.759901819 +0000 UTC m=+0.071146145 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106564 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2834a12ea88b6b0e3f08fce37e6f94 SystemUUID:ec2834a1-2ea8-8b6b-0e3f-08fce37e6f94 BootID:0cf45279-e949-4f62-a2f7-9ae8326aa23e Filesystems:[{Device:overlay_0-77 DeviceMajor:0 DeviceMinor:77 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1e39db65-958e-48e5-9b21-38c452e8b00f/volumes/kubernetes.io~projected/kube-api-access-qlxn5 DeviceMajor:0 DeviceMinor:224 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-264 DeviceMajor:0 DeviceMinor:264 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/8e4d414a-b040-4e77-9ddf-a37d04677415/volumes/kubernetes.io~projected/kube-api-access-7wrl4 DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6/volumes/kubernetes.io~projected/kube-api-access-sdtwq DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5fa55a0c6198fb389aa251ab421f882530bf1b1e78d70e4d5c9b965bd799fa8f/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/02f36dc3f76fc44caacadbea716bf435156ae21b66851bf1d2826cc1dc02662a/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173/volumes/kubernetes.io~projected/kube-api-access-n4mtp DeviceMajor:0 DeviceMinor:210 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-322 DeviceMajor:0 DeviceMinor:322 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c131273c1d9f389895b2bdff961edf059a8de053b0be7373939c87d1d3b0740d/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:218 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6f5e3a12ce080497d7ef963ad13868c301642ecd957f8f3852010b006e0cfc81/userdata/shm DeviceMajor:0 DeviceMinor:238 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-265 DeviceMajor:0 DeviceMinor:265 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-307 DeviceMajor:0 DeviceMinor:307 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~projected/kube-api-access-4px82 DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/af309a57d24a3599e7646c74e714006b5acc38aba314737c232f2145061d77ec/userdata/shm DeviceMajor:0 DeviceMinor:88 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-280 DeviceMajor:0 DeviceMinor:280 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1e39db65-958e-48e5-9b21-38c452e8b00f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/volumes/kubernetes.io~projected/kube-api-access-bp58p DeviceMajor:0 DeviceMinor:215 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/50c71f90-e5d1-41b1-a902-dec4b4df0571/volumes/kubernetes.io~projected/kube-api-access-w67dc DeviceMajor:0 DeviceMinor:217 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f174effe5b3fa438c0423f4bbe18a9745fe1b6723f23abf0069142fc028a5f3e/userdata/shm DeviceMajor:0 DeviceMinor:228 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/var/lib/kubelet/pods/23297409-95e7-435a-8bca-d70d93ea2c09/volumes/kubernetes.io~projected/kube-api-access-nxx7s DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~projected/kube-api-access-hqtw9 DeviceMajor:0 DeviceMinor:221 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/e9874f42-2ba3-4eba-af65-a6f114fcaaf6/volumes/kubernetes.io~projected/kube-api-access-ppptf DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-179 DeviceMajor:0 DeviceMinor:179 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/3c078f72-3706-4f1a-8f7b-24374afa43c8/volumes/kubernetes.io~projected/kube-api-access-m76k4 DeviceMajor:0 DeviceMinor:222 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/572f6f60-a6cb-4498-ada7-94531d16c807/volumes/kubernetes.io~projected/kube-api-access-wb4gk DeviceMajor:0 DeviceMinor:312 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2299d6c8-8676-4142-8744-a6869aa852fa/volumes/kubernetes.io~projected/kube-api-access-n6lrz DeviceMajor:0 DeviceMinor:227 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/66ee2c19b1ffc9c355e778708816d7e3e7238232357456edfe232d70c74a5e76/userdata/shm DeviceMajor:0 DeviceMinor:293 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2ebf8680-3179-4d73-abac-d53520204010/volumes/kubernetes.io~projected/kube-api-access-7zxx2 DeviceMajor:0 DeviceMinor:219 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff8898e343faecab753f63502d5af5d5887ef6fda52ef7e79ffaa86d22b7df17/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-89 DeviceMajor:0 DeviceMinor:89 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2bf369922fb5c4d80d58c05da0004e1055830ce47cc8359097f6238482dfd24c/userdata/shm DeviceMajor:0 DeviceMinor:348 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/131528b2-b2fe-4d0d-9260-db245d108396/volumes/kubernetes.io~projected/kube-api-access-s7rsg DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-176 DeviceMajor:0 DeviceMinor:176 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-380 DeviceMajor:0 DeviceMinor:380 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d04a0ba70fa5d8ca0fbacec35bb91d878163c4ffdb6ff822ce511b8b6d0f058/userdata/shm DeviceMajor:0 DeviceMinor:236 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:209 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0735d72325bf0946eae21150041f695bce197e68f4b4b725765a237cc1b81e83/userdata/shm DeviceMajor:0 DeviceMinor:356 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2299d6c8-8676-4142-8744-a6869aa852fa/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:206 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/86d517f1-0115-4d62-983c-2ad7b98ebb94/volumes/kubernetes.io~projected/kube-api-access-gfwr4 DeviceMajor:0 DeviceMinor:211 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~projected/kube-api-access-kkpw5 DeviceMajor:0 DeviceMinor:216 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/55857705-54d1-4c50-89bc-ba0ea23d2fe0/volumes/kubernetes.io~projected/kube-api-access-7gw2g DeviceMajor:0 DeviceMinor:337 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:352 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/87f17a44-0885-45e5-81f1-300442c926b8/volumes/kubernetes.io~projected/kube-api-access-49qtk DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-137 DeviceMajor:0 DeviceMinor:137 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ecad68c0faf6cae120e46702e0a3705a3c6820739ebd255cacb569bfead1aa9f/userdata/shm DeviceMajor:0 DeviceMinor:234 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/a3b6629b-dbda-44d0-8f3e-7e3d52f84632/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/96cdaafe979146d61b148048ea8e2a1290c4db716e82129b1650104fb4b3a1f4/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:205 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/2aa5feeb-9699-4404-83e5-17cf95e7c17e/volumes/kubernetes.io~projected/kube-api-access-s25pf DeviceMajor:0 DeviceMinor:212 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-330 DeviceMajor:0 DeviceMinor:330 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-281 DeviceMajor:0 DeviceMinor:281 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/47a03578c98758937cca812279e61eeccfa8a929abd9ec4155e714f9a88508f7/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:208 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c228562a-e001-4c95-b864-719d90ae903f/volumes/kubernetes.io~projected/kube-api-access-2ss8k DeviceMajor:0 DeviceMinor:313 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/269176a7e56cea5e9d876b1ca52de3e73a65186bafd84045366f7cc5e13c9679/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes/kubernetes.io~projected/kube-api-access-5m6gf DeviceMajor:0 DeviceMinor:214 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f2e9e89c-8edc-48b1-a494-a265cd949867/volumes/kubernetes.io~projected/kube-api-access-9nqf4 DeviceMajor:0 DeviceMinor:223 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:226 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ce3bfe21-b153-4b04-95ce-68f8d3da6f07/volumes/kubernetes.io~projected/kube-api-access-hgwc9 DeviceMajor:0 DeviceMinor:336 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-353 DeviceMajor:0 DeviceMinor:353 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2e00bed0-7bc2-4322-b108-efb74a2ee6cd/volumes/kubernetes.io~projected/kube-api-access-5j9z8 DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/a2bd555f-4524-41ef-900a-25b26103bec8/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/00e165ed4a6b9e697a5e44772d01a41cd54b5d2b78d284d60a8c887a566358d3/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-276 DeviceMajor:0 DeviceMinor:276 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7f0c3a6a-b4fb-469f-9837-2f010a013a49/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:207 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/d6712f77-7134-416f-b4e9-271e5ba93e30/volumes/kubernetes.io~projected/kube-api-access-5d4lk DeviceMajor:0 DeviceMinor:225 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/44b17eb68ecc1adcdb0ea4143853d1c94a6b7f5b41583ffcf5437c3cfdfe3003/userdata/shm DeviceMajor:0 DeviceMinor:240 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4c894edaf6de16feaccb281b2855f02e25d94a55c06848ac80a080ea934e3977/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/03c6b963-7075-4411-9bc1-af2a05401cde/volumes/kubernetes.io~projected/kube-api-access-wmj87 DeviceMajor:0 DeviceMinor:213 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5339f59eddd5cba10644904871582c265e63c3acb6a48809216fa87fe8d6dc4f/userdata/shm DeviceMajor:0 DeviceMinor:232 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/738650e14b57d778b3b726b73fa45168b987757297c79631f0e23d3ddf254742/userdata/shm DeviceMajor:0 DeviceMinor:244 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a2d3b8003746a33583e49247b3e883cd33962c34daa07f45b6e7a3ed2af1d1d9/userdata/shm DeviceMajor:0 DeviceMinor:230 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-274 DeviceMajor:0 DeviceMinor:274 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a83a964-ea7b-449e-8473-6677bf54e3b0/volumes/kubernetes.io~projected/kube-api-access-j2dcl DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/83b74d19-08b5-4303-9ce2-be9e520230a3/volumes/kubernetes.io~projected/kube-api-access-rkgfn DeviceMajor:0 DeviceMinor:295 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b/volumes/kubernetes.io~projected/kube-api-access-hnlqd DeviceMajor:0 DeviceMinor:355 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a2bd555f-4524-41ef-900a-25b26103bec8/volumes/kubernetes.io~projected/kube-api-access-2ns77 DeviceMajor:0 DeviceMinor:220 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/036b470534928861109285297ae12ba0ee15aaca5c9c425bd4cf5acd23fcd984/userdata/shm DeviceMajor:0 DeviceMinor:241 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/784df82499e3c63abf0c4113ba4f77fd16586ca00b0d2b3993361381a5d884c7/userdata/shm DeviceMajor:0 DeviceMinor:346 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-350 DeviceMajor:0 DeviceMinor:350 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0f4d2bad-866f-4398-9654-7f726d906f8d/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6cf9cc14-3177-4dc4-8f45-ab8f230d185c/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:036b47053492886 MacAddress:3a:4d:4d:2a:ef:08 Speed:10000 Mtu:8901} {Name:0735d72325bf094 MacAddress:d2:2a:26:d6:45:da Speed:10000 Mtu:8901} {Name:0ee299238cec022 MacAddress:ca:86:7f:3e:1b:6b Speed:10000 Mtu:8901} {Name:2bf369922fb5c4d MacAddress:fe:4a:02:ea:5d:f0 Speed:10000 Mtu:8901} {Name:44b17eb68ecc1ad MacAddress:ae:78:41:8d:10:c9 Speed:10000 Mtu:8901} {Name:47a03578c987589 MacAddress:6a:59:ae:11:a6:62 Speed:10000 Mtu:8901} {Name:4c894edaf6de16f MacAddress:1a:57:a2:29:01:cd Speed:10000 Mtu:8901} {Name:5339f59eddd5cba MacAddress:7e:0c:96:cb:ba:25 Speed:10000 Mtu:8901} {Name:66ee2c19b1ffc9c MacAddress:a6:4d:f7:d9:c2:80 Speed:10000 Mtu:8901} {Name:6f5e3a12ce08049 MacAddress:62:5a:55:e6:69:e6 Speed:10000 Mtu:8901} {Name:738650e14b57d77 MacAddress:6e:cd:f2:93:cf:62 Speed:10000 Mtu:8901} {Name:784df82499e3c63 MacAddress:ee:28:10:08:46:40 Speed:10000 Mtu:8901} {Name:9d04a0ba70fa5d8 MacAddress:c6:ca:97:07:56:29 Speed:10000 Mtu:8901} {Name:a2d3b8003746a33 MacAddress:5a:15:9e:c7:85:80 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:dd:7f:25:c5 Speed:0 Mtu:9001} {Name:br-int MacAddress:fe:e8:2d:90:e4:92 Speed:0 Mtu:8901} {Name:ecad68c0faf6cae MacAddress:62:50:9f:f5:61:32 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:dd:7f:25:c5 Speed:0 Mtu:9001} {Name:f174effe5b3fa43 MacAddress:5e:30:ac:18:f4:75 Speed:10000 Mtu:8901} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:0a:31:95:6e:e0:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761399    5044 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761462    5044 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761757    5044 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761778    5044 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761915    5044 topology_manager.go:143] "Creating topology manager with none policy"
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761925    5044 container_manager_linux.go:311] "Creating device plugin manager"
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761944    5044 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761959    5044 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.761979    5044 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 29 23:13:08.762178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762169    5044 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 29 23:13:08.763203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762297    5044 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 29 23:13:08.763203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762330    5044 kubelet.go:493] "Attempting to sync node with API server"
Oct 29 23:13:08.763203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762343    5044 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 29 23:13:08.763203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762354    5044 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 29 23:13:08.763203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762362    5044 kubelet.go:405] "Adding apiserver pod source"
Oct 29 23:13:08.763203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.762372    5044 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 29 23:13:08.763473 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.763292    5044 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 29 23:13:08.763473 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.763303    5044 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 29 23:13:08.763776 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.763760    5044 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 29 23:13:08.765969 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.765952    5044 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 29 23:13:08.765969 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.765966    5044 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 29 23:13:08.766091 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766060    5044 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 29 23:13:08.766250 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766240    5044 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 29 23:13:08.766284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766268    5044 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 29 23:13:08.766366 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766357    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766371    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766378    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766383    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766390    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766396    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766402    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766408    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 29 23:13:08.766411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766414    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 29 23:13:08.766670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766420    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 29 23:13:08.766670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766437    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 29 23:13:08.766670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766446    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 29 23:13:08.766670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766472    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 29 23:13:08.766670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.766493    5044 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 29 23:13:08.769990 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.769975    5044 server.go:1263] "Started kubelet"
Oct 29 23:13:08.770068 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.770026    5044 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 29 23:13:08.770564 ip-10-0-134-8 systemd[1]: Started Kubernetes Kubelet.
Oct 29 23:13:08.770728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.770071    5044 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 29 23:13:08.770728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.770717    5044 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 29 23:13:08.771039 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.771020    5044 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 29 23:13:08.775448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.771367    5044 server.go:317] "Adding debug handlers to kubelet server"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778019    5044 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778062    5044 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778078    5044 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-28 23:07:29 +0000 UTC" deadline="2028-05-12 14:21:58.652887235 +0000 UTC"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778111    5044 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13455h8m49.874779739s"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778178    5044 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778193    5044 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 29 23:13:08.778692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.778262    5044 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 29 23:13:08.780531 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:08.779455    5044 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-134-8.ec2.internal\" not found"
Oct 29 23:13:08.780531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.779703    5044 factory.go:55] Registering systemd factory
Oct 29 23:13:08.780531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.779721    5044 factory.go:223] Registration of the systemd container factory successfully
Oct 29 23:13:08.780724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.780631    5044 factory.go:153] Registering CRI-O factory
Oct 29 23:13:08.780724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.780648    5044 factory.go:223] Registration of the crio container factory successfully
Oct 29 23:13:08.780724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.780707    5044 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 29 23:13:08.780879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.780730    5044 factory.go:103] Registering Raw factory
Oct 29 23:13:08.780879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.780749    5044 manager.go:1199] Started watching for new ooms in manager
Oct 29 23:13:08.781126 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.781112    5044 manager.go:319] Starting recovery of all containers
Oct 29 23:13:08.782738 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782688    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a83a964-ea7b-449e-8473-6677bf54e3b0" volumeName="kubernetes.io/projected/5a83a964-ea7b-449e-8473-6677bf54e3b0-kube-api-access-j2dcl" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782740    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3b6629b-dbda-44d0-8f3e-7e3d52f84632" volumeName="kubernetes.io/configmap/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-konnectivity-ca" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782755    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e00bed0-7bc2-4322-b108-efb74a2ee6cd" volumeName="kubernetes.io/projected/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-kube-api-access-5j9z8" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782768    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86d517f1-0115-4d62-983c-2ad7b98ebb94" volumeName="kubernetes.io/configmap/86d517f1-0115-4d62-983c-2ad7b98ebb94-telemetry-config" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782781    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782793    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782805    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2299d6c8-8676-4142-8744-a6869aa852fa" volumeName="kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-service-ca-bundle" seLinuxMountContext=""
Oct 29 23:13:08.782822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782816    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="55857705-54d1-4c50-89bc-ba0ea23d2fe0" volumeName="kubernetes.io/projected/55857705-54d1-4c50-89bc-ba0ea23d2fe0-kube-api-access-7gw2g" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782831    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2bd555f-4524-41ef-900a-25b26103bec8" volumeName="kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-trusted-ca" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782841    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2bd555f-4524-41ef-900a-25b26103bec8" volumeName="kubernetes.io/secret/a2bd555f-4524-41ef-900a-25b26103bec8-serving-cert" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782855    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3c078f72-3706-4f1a-8f7b-24374afa43c8" volumeName="kubernetes.io/projected/3c078f72-3706-4f1a-8f7b-24374afa43c8-kube-api-access-m76k4" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782866    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="572f6f60-a6cb-4498-ada7-94531d16c807" volumeName="kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782878    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="791d6e15-ebf3-4d7a-b4d2-c5d11b17c173" volumeName="kubernetes.io/configmap/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-config" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782889    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87f17a44-0885-45e5-81f1-300442c926b8" volumeName="kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-config" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782903    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" volumeName="kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782916    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ce3bfe21-b153-4b04-95ce-68f8d3da6f07" volumeName="kubernetes.io/projected/ce3bfe21-b153-4b04-95ce-68f8d3da6f07-kube-api-access-hgwc9" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782943    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782967    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.782978    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b" volumeName="kubernetes.io/secret/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-key" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783003    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="03c6b963-7075-4411-9bc1-af2a05401cde" volumeName="kubernetes.io/projected/03c6b963-7075-4411-9bc1-af2a05401cde-kube-api-access-wmj87" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783016    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e39db65-958e-48e5-9b21-38c452e8b00f" volumeName="kubernetes.io/secret/1e39db65-958e-48e5-9b21-38c452e8b00f-serving-cert" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783027    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2299d6c8-8676-4142-8744-a6869aa852fa" volumeName="kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-trusted-ca-bundle" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783039    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6cf9cc14-3177-4dc4-8f45-ab8f230d185c" volumeName="kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783051    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="791d6e15-ebf3-4d7a-b4d2-c5d11b17c173" volumeName="kubernetes.io/projected/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-kube-api-access-n4mtp" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783063    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="83b74d19-08b5-4303-9ce2-be9e520230a3" volumeName="kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783106    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783120    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="572f6f60-a6cb-4498-ada7-94531d16c807" volumeName="kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path" seLinuxMountContext=""
Oct 29 23:13:08.783131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783131    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="86d517f1-0115-4d62-983c-2ad7b98ebb94" volumeName="kubernetes.io/projected/86d517f1-0115-4d62-983c-2ad7b98ebb94-kube-api-access-gfwr4" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783150    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87f17a44-0885-45e5-81f1-300442c926b8" volumeName="kubernetes.io/secret/87f17a44-0885-45e5-81f1-300442c926b8-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783163    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" volumeName="kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783175    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783189    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783220    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="23297409-95e7-435a-8bca-d70d93ea2c09" volumeName="kubernetes.io/projected/23297409-95e7-435a-8bca-d70d93ea2c09-kube-api-access-nxx7s" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783233    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="572f6f60-a6cb-4498-ada7-94531d16c807" volumeName="kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783255    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f0c3a6a-b4fb-469f-9837-2f010a013a49" volumeName="kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-stats-auth" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783266    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87f17a44-0885-45e5-81f1-300442c926b8" volumeName="kubernetes.io/projected/87f17a44-0885-45e5-81f1-300442c926b8-kube-api-access-49qtk" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783294    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783310    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3d008fa-a5ed-4811-8ed3-ba9193e7eff6" volumeName="kubernetes.io/projected/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-kube-api-access-bp58p" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783322    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783340    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783361    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f0c3a6a-b4fb-469f-9837-2f010a013a49" volumeName="kubernetes.io/projected/7f0c3a6a-b4fb-469f-9837-2f010a013a49-kube-api-access-hqtw9" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783373    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e4d414a-b040-4e77-9ddf-a37d04677415" volumeName="kubernetes.io/projected/8e4d414a-b040-4e77-9ddf-a37d04677415-kube-api-access-7wrl4" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783386    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783398    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d6712f77-7134-416f-b4e9-271e5ba93e30" volumeName="kubernetes.io/projected/d6712f77-7134-416f-b4e9-271e5ba93e30-kube-api-access-5d4lk" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783411    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9874f42-2ba3-4eba-af65-a6f114fcaaf6" volumeName="kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-daemon-config" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783425    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9874f42-2ba3-4eba-af65-a6f114fcaaf6" volumeName="kubernetes.io/projected/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-kube-api-access-ppptf" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783438    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f68b6b5d-44aa-4e94-b320-a669b4f09250" volumeName="kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783452    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f4d2bad-866f-4398-9654-7f726d906f8d" volumeName="kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-tuned" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783469    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2299d6c8-8676-4142-8744-a6869aa852fa" volumeName="kubernetes.io/projected/2299d6c8-8676-4142-8744-a6869aa852fa-kube-api-access-n6lrz" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783500    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9874f42-2ba3-4eba-af65-a6f114fcaaf6" volumeName="kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cni-binary-copy" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783513    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f4d2bad-866f-4398-9654-7f726d906f8d" volumeName="kubernetes.io/projected/0f4d2bad-866f-4398-9654-7f726d906f8d-kube-api-access-4px82" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783528    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50c71f90-e5d1-41b1-a902-dec4b4df0571" volumeName="kubernetes.io/projected/50c71f90-e5d1-41b1-a902-dec4b4df0571-kube-api-access-w67dc" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783542    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b" volumeName="kubernetes.io/projected/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-kube-api-access-hnlqd" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783556    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c228562a-e001-4c95-b864-719d90ae903f" volumeName="kubernetes.io/empty-dir/c228562a-e001-4c95-b864-719d90ae903f-data-volume" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783573    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2299d6c8-8676-4142-8744-a6869aa852fa" volumeName="kubernetes.io/secret/2299d6c8-8676-4142-8744-a6869aa852fa-serving-cert" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783587    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2e00bed0-7bc2-4322-b108-efb74a2ee6cd" volumeName="kubernetes.io/empty-dir/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-tmp-dir" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783611    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="791d6e15-ebf3-4d7a-b4d2-c5d11b17c173" volumeName="kubernetes.io/secret/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-serving-cert" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783623    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7f0c3a6a-b4fb-469f-9837-2f010a013a49" volumeName="kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-default-certificate" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783637    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2299d6c8-8676-4142-8744-a6869aa852fa" volumeName="kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-snapshots" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783650    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ebf8680-3179-4d73-abac-d53520204010" volumeName="kubernetes.io/empty-dir/2ebf8680-3179-4d73-abac-d53520204010-tmp-dir" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783662    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87f17a44-0885-45e5-81f1-300442c926b8" volumeName="kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-env-overrides" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783674    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" volumeName="kubernetes.io/projected/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-kube-api-access-sdtwq" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783686    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8e4d414a-b040-4e77-9ddf-a37d04677415" volumeName="kubernetes.io/configmap/8e4d414a-b040-4e77-9ddf-a37d04677415-serviceca" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783698    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b" volumeName="kubernetes.io/configmap/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-cabundle" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783711    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="131528b2-b2fe-4d0d-9260-db245d108396" volumeName="kubernetes.io/configmap/131528b2-b2fe-4d0d-9260-db245d108396-iptables-alerter-script" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783722    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e39db65-958e-48e5-9b21-38c452e8b00f" volumeName="kubernetes.io/configmap/1e39db65-958e-48e5-9b21-38c452e8b00f-config" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783733    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ebf8680-3179-4d73-abac-d53520204010" volumeName="kubernetes.io/configmap/2ebf8680-3179-4d73-abac-d53520204010-config-volume" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783745    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2bd555f-4524-41ef-900a-25b26103bec8" volumeName="kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-config" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783758    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a3b6629b-dbda-44d0-8f3e-7e3d52f84632" volumeName="kubernetes.io/secret/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-agent-certs" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783769    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="b3d008fa-a5ed-4811-8ed3-ba9193e7eff6" volumeName="kubernetes.io/secret/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-cert" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783781    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0f4d2bad-866f-4398-9654-7f726d906f8d" volumeName="kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-tmp" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783792    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2aa5feeb-9699-4404-83e5-17cf95e7c17e" volumeName="kubernetes.io/projected/2aa5feeb-9699-4404-83e5-17cf95e7c17e-kube-api-access-s25pf" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783803    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2ebf8680-3179-4d73-abac-d53520204010" volumeName="kubernetes.io/projected/2ebf8680-3179-4d73-abac-d53520204010-kube-api-access-7zxx2" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783814    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="87f17a44-0885-45e5-81f1-300442c926b8" volumeName="kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-script-lib" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783825    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783847    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c228562a-e001-4c95-b864-719d90ae903f" volumeName="kubernetes.io/projected/c228562a-e001-4c95-b864-719d90ae903f-kube-api-access-2ss8k" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783860    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e00a2559-ea47-4bde-9c63-a175add6c791" volumeName="kubernetes.io/configmap/e00a2559-ea47-4bde-9c63-a175add6c791-nginx-conf" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783872    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2299d6c8-8676-4142-8744-a6869aa852fa" volumeName="kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-tmp" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783882    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="572f6f60-a6cb-4498-ada7-94531d16c807" volumeName="kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783894    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2bd555f-4524-41ef-900a-25b26103bec8" volumeName="kubernetes.io/projected/a2bd555f-4524-41ef-900a-25b26103bec8-kube-api-access-2ns77" seLinuxMountContext=""
Oct 29 23:13:08.783875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783907    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2e9e89c-8edc-48b1-a494-a265cd949867" volumeName="kubernetes.io/configmap/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-config" seLinuxMountContext=""
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783917    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2e9e89c-8edc-48b1-a494-a265cd949867" volumeName="kubernetes.io/projected/f2e9e89c-8edc-48b1-a494-a265cd949867-kube-api-access-9nqf4" seLinuxMountContext=""
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783930    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="131528b2-b2fe-4d0d-9260-db245d108396" volumeName="kubernetes.io/projected/131528b2-b2fe-4d0d-9260-db245d108396-kube-api-access-s7rsg" seLinuxMountContext=""
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783942    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e39db65-958e-48e5-9b21-38c452e8b00f" volumeName="kubernetes.io/projected/1e39db65-958e-48e5-9b21-38c452e8b00f-kube-api-access-qlxn5" seLinuxMountContext=""
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783953    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="99e1c2a2-3edf-450a-9de0-ec803ff28569" volumeName="kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf" seLinuxMountContext=""
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783964    5044 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" volumeName="kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-binary-copy" seLinuxMountContext=""
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783976    5044 reconstruct.go:97] "Volume reconstruction finished"
Oct 29 23:13:08.785564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.783983    5044 reconciler.go:29] "Reconciler: start to sync state"
Oct 29 23:13:08.803985 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.803958    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/1.log"
Oct 29 23:13:08.804121 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.804064    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/1.log"
Oct 29 23:13:08.805272 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.805238    5044 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 29 23:13:08.813014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.812990    5044 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 29 23:13:08.813014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.813014    5044 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 29 23:13:08.813191 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.813035    5044 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 29 23:13:08.813191 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:08.813077    5044 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 29 23:13:08.816699 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.816681    5044 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:13:08.817097 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.816932    5044 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 29 23:13:08.817929 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.817911    5044 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:13:08.828299 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.827737    5044 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:13:08.847535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.846132    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="b1189e8930e8e1079d2a5c6204cbdec8ce4253b721d2ece2d5e1fea7cbd4531e" exitCode=0
Oct 29 23:13:08.847535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.846161    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="5da10aff2c9083eb2349ae857efa0c05b12a9160449dd7da3f0049f875b8c00b" exitCode=0
Oct 29 23:13:08.847535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.846171    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="9cee9a507334a6e5e8178857f0f641024e99197a274045735bc458ac50a39efc" exitCode=0
Oct 29 23:13:08.847535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.846180    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="37de8547b33f539c689210b5456b30f0e1c109ff2fa8b4b7de2f0eea362b02c2" exitCode=0
Oct 29 23:13:08.847535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.846189    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="73fee79ec345a35700d2be4fe3eea8e69de48e2e6f1ee0cb4274bfa641371ec6" exitCode=0
Oct 29 23:13:08.847535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.846199    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b7a7da2-cbef-4283-b2c2-3712e53aa9c6" containerID="f155c2067b7f61a37d1a725ba9d88d68880d01da12e6af4a0f9cbaaa16ceeca7" exitCode=0
Oct 29 23:13:08.848294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.848276    5044 generic.go:356] "Generic (PLEG): container finished" podID="ae1baf8a433f591d10b63e86535dd962" containerID="2ef50ff80833b2571a8ff484cee1467b771c825f8e38b766e674364f8e6faa54" exitCode=0
Oct 29 23:13:08.864943 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.864918    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/1.log"
Oct 29 23:13:08.865024 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.864960    5044 generic.go:356] "Generic (PLEG): container finished" podID="a2bd555f-4524-41ef-900a-25b26103bec8" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d" exitCode=255
Oct 29 23:13:08.885073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.885052    5044 manager.go:324] Recovery completed
Oct 29 23:13:08.889141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.889122    5044 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 29 23:13:08.905186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905168    5044 cpu_manager.go:226] "Starting" policy="none"
Oct 29 23:13:08.905186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905183    5044 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 29 23:13:08.905339 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905203    5044 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 29 23:13:08.905404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905360    5044 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 29 23:13:08.905404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905376    5044 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 29 23:13:08.905404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905400    5044 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 29 23:13:08.905577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905409    5044 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 29 23:13:08.905577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905417    5044 policy_none.go:50] "Start"
Oct 29 23:13:08.905577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905429    5044 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 29 23:13:08.905577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905442    5044 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 29 23:13:08.905791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905661    5044 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 29 23:13:08.905791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905673    5044 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 29 23:13:08.905791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.905681    5044 policy_none.go:44] "Start"
Oct 29 23:13:08.910116 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.910090    5044 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 29 23:13:08.912785 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.912772    5044 manager.go:341] "Starting Device Plugin manager"
Oct 29 23:13:08.913216 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:08.913198    5044 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 29 23:13:08.913301 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:08.912797    5044 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 29 23:13:08.913336 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913305    5044 server.go:87] "Starting device plugin registration server"
Oct 29 23:13:08.913566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913555    5044 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 29 23:13:08.913601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913568    5044 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 29 23:13:08.913681 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913663    5044 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 29 23:13:08.913795 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913757    5044 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 29 23:13:08.913838 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913804    5044 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 29 23:13:08.913838 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913813    5044 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 29 23:13:08.913904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.913851    5044 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-29T23:13:08.913791855Z","UUID":"99117631-0cf9-4146-9e4e-88088685bd86","Handler":null,"Name":"","Endpoint":""}
Oct 29 23:13:08.915529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.915453    5044 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 29 23:13:08.915611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:08.915538    5044 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 29 23:13:08.916152 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:08.916125    5044 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 29 23:13:09.014258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.014230    5044 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 29 23:13:09.015470 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.015450    5044 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientMemory"
Oct 29 23:13:09.015588 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.015513    5044 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasNoDiskPressure"
Oct 29 23:13:09.015588 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.015528    5044 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-134-8.ec2.internal" event="NodeHasSufficientPID"
Oct 29 23:13:09.015588 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.015584    5044 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.044422 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.044392    5044 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.044573 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.044502    5044 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.113403 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.113310    5044 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"]
Oct 29 23:13:09.114006 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.113961    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"ae1baf8a433f591d10b63e86535dd962","Type":"ContainerStarted","Data":"fe224d23c01e44ac35530bb404bf3a021a59211816fde0976ad85ab1a73c062e"}
Oct 29 23:13:09.114127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.114021    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"ae1baf8a433f591d10b63e86535dd962","Type":"ContainerDied","Data":"2ef50ff80833b2571a8ff484cee1467b771c825f8e38b766e674364f8e6faa54"}
Oct 29 23:13:09.114127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.114044    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal" event={"ID":"ae1baf8a433f591d10b63e86535dd962","Type":"ContainerStarted","Data":"2add5b12b46f7498fc80c8c42064154b00f2d75f5e439c1376884648bc745ea0"}
Oct 29 23:13:09.114127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.114063    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" event={"ID":"8b2fbb4e01546248a6da67f357b48b89","Type":"ContainerStarted","Data":"009483e401535c4fe1a79613afd63968aa6bd05daaf4d9769e7205ceaeab9179"}
Oct 29 23:13:09.114127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.114075    5044 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.114270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.114079    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal" event={"ID":"8b2fbb4e01546248a6da67f357b48b89","Type":"ContainerStarted","Data":"d21c64ab8daded7d46715e6adecc7a309d5cd38903da0eb11685e964cdb31a2d"}
Oct 29 23:13:09.114270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.114153    5044 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.137041 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.137020    5044 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 29 23:13:09.137124 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.137052    5044 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 29 23:13:09.137124 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:09.137077    5044 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.137124 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:09.137094    5044 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.219434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.219404    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b2fbb4e01546248a6da67f357b48b89-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"8b2fbb4e01546248a6da67f357b48b89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.219434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.219435    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.219655 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.219461    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.319608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.319575    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.319608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.319610    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.319793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.319634    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b2fbb4e01546248a6da67f357b48b89-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"8b2fbb4e01546248a6da67f357b48b89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.319793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.319686    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.319793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.319721    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b2fbb4e01546248a6da67f357b48b89-config\") pod \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" (UID: \"8b2fbb4e01546248a6da67f357b48b89\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.319793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.319693    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae1baf8a433f591d10b63e86535dd962-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" (UID: \"ae1baf8a433f591d10b63e86535dd962\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.763182 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.763148    5044 apiserver.go:52] "Watching apiserver"
Oct 29 23:13:09.857764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.857736    5044 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 29 23:13:09.858408 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.858378    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj","openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp","openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb","openshift-image-registry/node-ca-qcbhg","openshift-ovn-kubernetes/ovnkube-node-d7dc6","openshift-network-operator/iptables-alerter-zb2cb","openshift-monitoring/cluster-monitoring-operator-884576c57-tx897","openshift-insights/periodic-gathering-79nrp-sxknn","openshift-network-diagnostics/network-check-target-sd6x7","openshift-multus/multus-gcnnc","openshift-insights/insights-runtime-extractor-sgk28","openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc","openshift-dns/node-resolver-lw2vc","kube-system/kas-connection-checker-685895c7c9-25hfz","openshift-multus/multus-additional-cni-plugins-wzmpl","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn","openshift-cluster-node-tuning-operator/tuned-4wqmx","openshift-dns/dns-default-f8lst","kube-system/konnectivity-agent-8b26b","openshift-ingress/router-default-5d7cd8c56f-8gsnl","kube-system/global-pull-secret-syncer-l4dmt","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2","openshift-network-console/networking-console-plugin-86c478bb88-qnzcj","openshift-multus/network-metrics-daemon-dpbxx","openshift-console-operator/console-operator-7cd56b8dbc-nd299","openshift-ingress-canary/ingress-canary-vqvz7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp","kube-system/kas-connection-checker-685895c7c9-nh9gd","kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal","openshift-insights/insights-operator-7c4986d449-f8sqw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal","openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z","openshift-image-registry/image-registry-6b87f698cd-z5z9k","kube-system/kas-connection-checker-685895c7c9-jlxrw","openshift-service-ca/service-ca-5fffc97bdf-6brzf"]
Oct 29 23:13:09.859731 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.859710    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:09.860042 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.860026    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.861022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.861005    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:09.861392 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.861372    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.863013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.862993    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:09.867569 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.867551    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:09.868923 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.868906    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.873200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.873175    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.873516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.873497    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.877595 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.877568    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 29 23:13:09.877860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.877841    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 29 23:13:09.877970 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.877866    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 29 23:13:09.877970 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.877867    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 29 23:13:09.878075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.877974    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 29 23:13:09.878075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.877996    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 29 23:13:09.878075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878050    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 29 23:13:09.878075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878068    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.878221 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878099    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 29 23:13:09.878221 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878114    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 29 23:13:09.878293 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878232    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.878330 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878289    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 29 23:13:09.878368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878355    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.878413 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878378    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.878513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878500    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.878622 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878607    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.878669 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878612    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.878669 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878632    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.878765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878723    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.878765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.878737    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.879800 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.879784    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 29 23:13:09.880373 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.880361    5044 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 29 23:13:09.884638 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.884624    5044 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.884740 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.884728    5044 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.887867 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.887852    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 29 23:13:09.888371 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.888357    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 29 23:13:09.889766 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.889750    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.889848 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.889784    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.889848 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.889834    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.890004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.889853    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 29 23:13:09.890004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.889877    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.890004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.889879    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890023    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890036    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890044    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890053    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890023    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890094    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.890173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890097    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 29 23:13:09.890363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890282    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.890363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890350    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.890533 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890518    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 29 23:13:09.890584 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890520    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 29 23:13:09.890584 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890543    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.890584 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.890568    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 29 23:13:09.897665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.897650    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 29 23:13:09.897711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.897677    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 29 23:13:09.898082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.898061    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 29 23:13:09.898216 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.898201    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.898399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.898379    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.898500 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.898466    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 29 23:13:09.898583 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.898552    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899055 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899037    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899277    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899369 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899333    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.899416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899378    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 29 23:13:09.899416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899386    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 29 23:13:09.899558 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899541    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 29 23:13:09.899608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899555    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899612    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.899705 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899638    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.899705 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899685    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899745    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899756    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 29 23:13:09.899865 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899790    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 29 23:13:09.899914 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899892    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.899959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899914    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 29 23:13:09.900007 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.899967    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 29 23:13:09.900049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.900031    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.900092 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.900060    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 29 23:13:09.900172 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.900158    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.900235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.900187    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.900235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.900231    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 29 23:13:09.900325 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.900252    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 29 23:13:09.907407 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.907391    5044 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 29 23:13:09.907492 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:09.907430    5044 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-134-8.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.908078 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.908066    5044 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 29 23:13:09.908122 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:09.908105    5044 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-8.ec2.internal"
Oct 29 23:13:09.922811 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.922795    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.922876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.922822    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-daemon-config\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.922876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.922839    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-systemd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.922876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.922856    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-kubelet-config\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:09.922988 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.922918    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-conf-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.923028 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.922994    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-trusted-ca\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.923064 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923025    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.923122 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923105    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2299d6c8-8676-4142-8744-a6869aa852fa-serving-cert\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.923173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923137    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.923173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923164    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qtk\" (UniqueName: \"kubernetes.io/projected/87f17a44-0885-45e5-81f1-300442c926b8-kube-api-access-49qtk\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.923283 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923189    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.923283 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923215    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-service-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.923283 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923221    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-daemon-config\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.923283 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923254    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-socket-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.923283 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923280    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.923542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923305    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdtwq\" (UniqueName: \"kubernetes.io/projected/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-kube-api-access-sdtwq\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.923542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923333    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-konnectivity-ca\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:13:09.923542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923335    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-trusted-ca\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.923542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923336    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-binary-copy\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.923542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923358    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-node-log\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.923542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923382    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-conf\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923559    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923568    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-key\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923564    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923677    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923709    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-config\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923711    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2299d6c8-8676-4142-8744-a6869aa852fa-serving-cert\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.923796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923736    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923800    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923806    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923821    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923832    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e00a2559-ea47-4bde-9c63-a175add6c791-nginx-conf\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923855    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-konnectivity-ca\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923866    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923896    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nqf4\" (UniqueName: \"kubernetes.io/projected/f2e9e89c-8edc-48b1-a494-a265cd949867-kube-api-access-9nqf4\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923911    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-config\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923921    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-snapshots\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923966    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.923989    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2299d6c8-8676-4142-8744-a6869aa852fa-service-ca-bundle\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924002    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924032    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w67dc\" (UniqueName: \"kubernetes.io/projected/50c71f90-e5d1-41b1-a902-dec4b4df0571-kube-api-access-w67dc\") pod \"kas-connection-checker-685895c7c9-25hfz\" (UID: \"50c71f90-e5d1-41b1-a902-dec4b4df0571\") " pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924052    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-snapshots\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924064    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j9z8\" (UniqueName: \"kubernetes.io/projected/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-kube-api-access-5j9z8\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:09.924119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924074    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e00a2559-ea47-4bde-9c63-a175add6c791-nginx-conf\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924177    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924266    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ebf8680-3179-4d73-abac-d53520204010-config-volume\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924298    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf8680-3179-4d73-abac-d53520204010-tmp-dir\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924325    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/131528b2-b2fe-4d0d-9260-db245d108396-host-slash\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924352    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfwr4\" (UniqueName: \"kubernetes.io/projected/86d517f1-0115-4d62-983c-2ad7b98ebb94-kube-api-access-gfwr4\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924378    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924382    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2ebf8680-3179-4d73-abac-d53520204010-tmp-dir\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924408    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-registration-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924409    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924441    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2ebf8680-3179-4d73-abac-d53520204010-config-volume\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924453    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwc9\" (UniqueName: \"kubernetes.io/projected/ce3bfe21-b153-4b04-95ce-68f8d3da6f07-kube-api-access-hgwc9\") pod \"migrator-66df5d496b-z92qb\" (UID: \"ce3bfe21-b153-4b04-95ce-68f8d3da6f07\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924518    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/131528b2-b2fe-4d0d-9260-db245d108396-iptables-alerter-script\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924544    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ss8k\" (UniqueName: \"kubernetes.io/projected/c228562a-e001-4c95-b864-719d90ae903f-kube-api-access-2ss8k\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924649    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysconfig\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924680    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924715    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-netd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924746    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/131528b2-b2fe-4d0d-9260-db245d108396-iptables-alerter-script\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924752    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924782    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924791    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924814    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.924840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924842    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-systemd-units\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924866    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4mtp\" (UniqueName: \"kubernetes.io/projected/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-kube-api-access-n4mtp\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.924919    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7rsg\" (UniqueName: \"kubernetes.io/projected/131528b2-b2fe-4d0d-9260-db245d108396-kube-api-access-s7rsg\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925046    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp58p\" (UniqueName: \"kubernetes.io/projected/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-kube-api-access-bp58p\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925080    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-modprobe-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925108    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd555f-4524-41ef-900a-25b26103bec8-serving-cert\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925144    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-bin\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925154    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925166    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-netns\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925185    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925211    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925231    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925249    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-kubernetes\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925279    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-multus\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925316    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-kubelet\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925340    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925378    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925410    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-kubelet\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925438    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925470    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxn5\" (UniqueName: \"kubernetes.io/projected/1e39db65-958e-48e5-9b21-38c452e8b00f-kube-api-access-qlxn5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925515    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-etc-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925555    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:09.925592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925583    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925619    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wrl4\" (UniqueName: \"kubernetes.io/projected/8e4d414a-b040-4e77-9ddf-a37d04677415-kube-api-access-7wrl4\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925636    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-system-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925651    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-device-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925672    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925707    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87f17a44-0885-45e5-81f1-300442c926b8-ovn-node-metrics-cert\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925744    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-run\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925783    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-tmp\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925810    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-hostroot\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925870    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925896    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-tmp\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.925899    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnlqd\" (UniqueName: \"kubernetes.io/projected/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-kube-api-access-hnlqd\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926005    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-tmp-dir\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926034    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-slash\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926074    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-tmp-dir\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926103    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-k8s-cni-cncf-io\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926136    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-dbus\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926152    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926168    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-script-lib\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926183    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-sys\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926199    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-config\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926213    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-systemd\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926411    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-ovnkube-script-lib\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926419    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-multus-certs\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926446    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-etc-kubernetes\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926446    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-config\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:13:09.926453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926464    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-agent-certs\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926514    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ns77\" (UniqueName: \"kubernetes.io/projected/a2bd555f-4524-41ef-900a-25b26103bec8-kube-api-access-2ns77\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926546    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cnibin\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926564    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926631    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926668    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxx7s\" (UniqueName: \"kubernetes.io/projected/23297409-95e7-435a-8bca-d70d93ea2c09-kube-api-access-nxx7s\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926694    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926726    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-ovn\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926826    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-env-overrides\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926869    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926895    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-cabundle\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926948    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2dcl\" (UniqueName: \"kubernetes.io/projected/5a83a964-ea7b-449e-8473-6677bf54e3b0-kube-api-access-j2dcl\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.926982    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87f17a44-0885-45e5-81f1-300442c926b8-env-overrides\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927020    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-serving-cert\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927038    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cni-binary-copy\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927070    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-var-lib-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927089    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-sys-fs\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927090    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-cabundle\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927106    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4d414a-b040-4e77-9ddf-a37d04677415-host\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927152    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e39db65-958e-48e5-9b21-38c452e8b00f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927184    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-netns\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927191    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-serving-cert\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927234    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927237    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cni-binary-copy\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927301    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-stats-auth\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927345    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1e39db65-958e-48e5-9b21-38c452e8b00f-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927382    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927374    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927408    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927431    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m76k4\" (UniqueName: \"kubernetes.io/projected/3c078f72-3706-4f1a-8f7b-24374afa43c8-kube-api-access-m76k4\") pod \"network-check-source-6f78d59f99-s7fcp\" (UID: \"3c078f72-3706-4f1a-8f7b-24374afa43c8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927456    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zxx2\" (UniqueName: \"kubernetes.io/projected/2ebf8680-3179-4d73-abac-d53520204010-kube-api-access-7zxx2\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.927456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927472    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-default-certificate\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927509    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-var-lib-kubelet\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927531    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-host\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927569    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-config\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927572    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-stats-auth\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927608    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927636    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927655    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927693    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gw2g\" (UniqueName: \"kubernetes.io/projected/55857705-54d1-4c50-89bc-ba0ea23d2fe0-kube-api-access-7gw2g\") pod \"migrator-66df5d496b-xzbjc\" (UID: \"55857705-54d1-4c50-89bc-ba0ea23d2fe0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927721    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927728    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-default-certificate\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927748    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e39db65-958e-48e5-9b21-38c452e8b00f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927770    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a2bd555f-4524-41ef-900a-25b26103bec8-config\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927835    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927867    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmj87\" (UniqueName: \"kubernetes.io/projected/03c6b963-7075-4411-9bc1-af2a05401cde-kube-api-access-wmj87\") pod \"volume-data-source-validator-58c9f5f46d-bd4hn\" (UID: \"03c6b963-7075-4411-9bc1-af2a05401cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927917    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-lib-modules\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927937    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-system-cni-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.927964    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928057    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86d517f1-0115-4d62-983c-2ad7b98ebb94-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928118    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-log-socket\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928143    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-cert\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928242    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-socket-dir-parent\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928260    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928346    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/86d517f1-0115-4d62-983c-2ad7b98ebb94-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:09.928405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928353    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-bin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928408    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928442    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c228562a-e001-4c95-b864-719d90ae903f-data-volume\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928452    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928459    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928514    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6lrz\" (UniqueName: \"kubernetes.io/projected/2299d6c8-8676-4142-8744-a6869aa852fa-kube-api-access-n6lrz\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928557    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c228562a-e001-4c95-b864-719d90ae903f-data-volume\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928598    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928651    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928664    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cnibin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928708    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d4lk\" (UniqueName: \"kubernetes.io/projected/d6712f77-7134-416f-b4e9-271e5ba93e30-kube-api-access-5d4lk\") pod \"kas-connection-checker-685895c7c9-nh9gd\" (UID: \"d6712f77-7134-416f-b4e9-271e5ba93e30\") " pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928736    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s25pf\" (UniqueName: \"kubernetes.io/projected/2aa5feeb-9699-4404-83e5-17cf95e7c17e-kube-api-access-s25pf\") pod \"kas-connection-checker-685895c7c9-jlxrw\" (UID: \"2aa5feeb-9699-4404-83e5-17cf95e7c17e\") " pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928831    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-hosts-file\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928849    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-tmp\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928893    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928907    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2299d6c8-8676-4142-8744-a6869aa852fa-tmp\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928931    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqtw9\" (UniqueName: \"kubernetes.io/projected/7f0c3a6a-b4fb-469f-9837-2f010a013a49-kube-api-access-hqtw9\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928948    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4d414a-b040-4e77-9ddf-a37d04677415-serviceca\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928977    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c228562a-e001-4c95-b864-719d90ae903f-crio-socket\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.928998    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-tuned\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.929046    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4px82\" (UniqueName: \"kubernetes.io/projected/0f4d2bad-866f-4398-9654-7f726d906f8d-kube-api-access-4px82\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.929078    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppptf\" (UniqueName: \"kubernetes.io/projected/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-kube-api-access-ppptf\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.929053    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-tuned\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.929114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.929106    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.929763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.929214    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8e4d414a-b040-4e77-9ddf-a37d04677415-serviceca\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:09.939830 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.939813    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdtwq\" (UniqueName: \"kubernetes.io/projected/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-kube-api-access-sdtwq\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:09.939968 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.939947    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67dc\" (UniqueName: \"kubernetes.io/projected/50c71f90-e5d1-41b1-a902-dec4b4df0571-kube-api-access-w67dc\") pod \"kas-connection-checker-685895c7c9-25hfz\" (UID: \"50c71f90-e5d1-41b1-a902-dec4b4df0571\") " pod="kube-system/kas-connection-checker-685895c7c9-25hfz"
Oct 29 23:13:09.940088 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.940075    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") pod \"periodic-gathering-79nrp-sxknn\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") " pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:09.944112 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.944096    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nqf4\" (UniqueName: \"kubernetes.io/projected/f2e9e89c-8edc-48b1-a494-a265cd949867-kube-api-access-9nqf4\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:09.944266 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.944251    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxn5\" (UniqueName: \"kubernetes.io/projected/1e39db65-958e-48e5-9b21-38c452e8b00f-kube-api-access-qlxn5\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:13:09.945270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.945252    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfwr4\" (UniqueName: \"kubernetes.io/projected/86d517f1-0115-4d62-983c-2ad7b98ebb94-kube-api-access-gfwr4\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:09.945763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.945705    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwc9\" (UniqueName: \"kubernetes.io/projected/ce3bfe21-b153-4b04-95ce-68f8d3da6f07-kube-api-access-hgwc9\") pod \"migrator-66df5d496b-z92qb\" (UID: \"ce3bfe21-b153-4b04-95ce-68f8d3da6f07\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-z92qb"
Oct 29 23:13:09.945882 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.945864    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7rsg\" (UniqueName: \"kubernetes.io/projected/131528b2-b2fe-4d0d-9260-db245d108396-kube-api-access-s7rsg\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:09.946110 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.946090    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qtk\" (UniqueName: \"kubernetes.io/projected/87f17a44-0885-45e5-81f1-300442c926b8-kube-api-access-49qtk\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.946177 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.946165    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.946229 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.946201    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j9z8\" (UniqueName: \"kubernetes.io/projected/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-kube-api-access-5j9z8\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:09.946513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.946469    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.946582 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.946569    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4mtp\" (UniqueName: \"kubernetes.io/projected/791d6e15-ebf3-4d7a-b4d2-c5d11b17c173-kube-api-access-n4mtp\") pod \"service-ca-operator-544d749c8c-4rs7z\" (UID: \"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z"
Oct 29 23:13:09.949865 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.949822    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wrl4\" (UniqueName: \"kubernetes.io/projected/8e4d414a-b040-4e77-9ddf-a37d04677415-kube-api-access-7wrl4\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:09.950166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950143    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2dcl\" (UniqueName: \"kubernetes.io/projected/5a83a964-ea7b-449e-8473-6677bf54e3b0-kube-api-access-j2dcl\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:09.950284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950263    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxx7s\" (UniqueName: \"kubernetes.io/projected/23297409-95e7-435a-8bca-d70d93ea2c09-kube-api-access-nxx7s\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:09.950363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950328    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.950363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950355    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ns77\" (UniqueName: \"kubernetes.io/projected/a2bd555f-4524-41ef-900a-25b26103bec8-kube-api-access-2ns77\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.950535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950519    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnlqd\" (UniqueName: \"kubernetes.io/projected/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-kube-api-access-hnlqd\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:09.950592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950515    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkgfn\" (UniqueName: \"kubernetes.io/projected/83b74d19-08b5-4303-9ce2-be9e520230a3-kube-api-access-rkgfn\") pod \"network-check-target-sd6x7\" (UID: \"83b74d19-08b5-4303-9ce2-be9e520230a3\") " pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:09.950592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.950562    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ss8k\" (UniqueName: \"kubernetes.io/projected/c228562a-e001-4c95-b864-719d90ae903f-kube-api-access-2ss8k\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:09.951954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.951938    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp58p\" (UniqueName: \"kubernetes.io/projected/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-kube-api-access-bp58p\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:13:09.953529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.953506    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmj87\" (UniqueName: \"kubernetes.io/projected/03c6b963-7075-4411-9bc1-af2a05401cde-kube-api-access-wmj87\") pod \"volume-data-source-validator-58c9f5f46d-bd4hn\" (UID: \"03c6b963-7075-4411-9bc1-af2a05401cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-bd4hn"
Oct 29 23:13:09.953710 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.953693    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zxx2\" (UniqueName: \"kubernetes.io/projected/2ebf8680-3179-4d73-abac-d53520204010-kube-api-access-7zxx2\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:09.953791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.953720    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqtw9\" (UniqueName: \"kubernetes.io/projected/7f0c3a6a-b4fb-469f-9837-2f010a013a49-kube-api-access-hqtw9\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:09.953920 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.953895    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.954027 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.953969    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s25pf\" (UniqueName: \"kubernetes.io/projected/2aa5feeb-9699-4404-83e5-17cf95e7c17e-kube-api-access-s25pf\") pod \"kas-connection-checker-685895c7c9-jlxrw\" (UID: \"2aa5feeb-9699-4404-83e5-17cf95e7c17e\") " pod="kube-system/kas-connection-checker-685895c7c9-jlxrw"
Oct 29 23:13:09.954090 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.954074    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d4lk\" (UniqueName: \"kubernetes.io/projected/d6712f77-7134-416f-b4e9-271e5ba93e30-kube-api-access-5d4lk\") pod \"kas-connection-checker-685895c7c9-nh9gd\" (UID: \"d6712f77-7134-416f-b4e9-271e5ba93e30\") " pod="kube-system/kas-connection-checker-685895c7c9-nh9gd"
Oct 29 23:13:09.954226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.954209    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m76k4\" (UniqueName: \"kubernetes.io/projected/3c078f72-3706-4f1a-8f7b-24374afa43c8-kube-api-access-m76k4\") pod \"network-check-source-6f78d59f99-s7fcp\" (UID: \"3c078f72-3706-4f1a-8f7b-24374afa43c8\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-s7fcp"
Oct 29 23:13:09.954309 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.954293    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4px82\" (UniqueName: \"kubernetes.io/projected/0f4d2bad-866f-4398-9654-7f726d906f8d-kube-api-access-4px82\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:09.954525 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.954505    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6lrz\" (UniqueName: \"kubernetes.io/projected/2299d6c8-8676-4142-8744-a6869aa852fa-kube-api-access-n6lrz\") pod \"insights-operator-7c4986d449-f8sqw\" (UID: \"2299d6c8-8676-4142-8744-a6869aa852fa\") " pod="openshift-insights/insights-operator-7c4986d449-f8sqw"
Oct 29 23:13:09.954603 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.954529    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gw2g\" (UniqueName: \"kubernetes.io/projected/55857705-54d1-4c50-89bc-ba0ea23d2fe0-kube-api-access-7gw2g\") pod \"migrator-66df5d496b-xzbjc\" (UID: \"55857705-54d1-4c50-89bc-ba0ea23d2fe0\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-xzbjc"
Oct 29 23:13:09.957093 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.957077    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppptf\" (UniqueName: \"kubernetes.io/projected/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-kube-api-access-ppptf\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:09.977664 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.977637    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 29 23:13:09.977809 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.977793    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 29 23:13:09.977888 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.977871    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 29 23:13:09.978165 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978136    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9nnrj\""
Oct 29 23:13:09.978262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978166    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 29 23:13:09.978262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978183    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-984bt\""
Oct 29 23:13:09.978262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978191    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 29 23:13:09.978262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978207    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 29 23:13:09.978262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978170    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978282    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-khznz\""
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978300    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978318    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978353    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-t5hzf\""
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978415    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978465    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3d008fa-a5ed-4811-8ed3-ba9193e7eff6-cert\") pod \"ingress-canary-vqvz7\" (UID: \"b3d008fa-a5ed-4811-8ed3-ba9193e7eff6\") " pod="openshift-ingress-canary/ingress-canary-vqvz7"
Oct 29 23:13:09.978507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978502    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-27bdq\""
Oct 29 23:13:09.978859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978667    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 29 23:13:09.978859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978778    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7kxr2\""
Oct 29 23:13:09.978957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978872    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 29 23:13:09.978957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.978949    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 29 23:13:09.979045 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979031    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-llmqc\""
Oct 29 23:13:09.979111 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979087    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lmxkp\""
Oct 29 23:13:09.979166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979145    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4s2ql\""
Oct 29 23:13:09.979211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979169    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 29 23:13:09.979211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979178    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-4755v\""
Oct 29 23:13:09.979211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979189    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 29 23:13:09.979211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979184    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-crphw\""
Oct 29 23:13:09.979388 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979225    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sr9lt\""
Oct 29 23:13:09.979388 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979269    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7lj8k\""
Oct 29 23:13:09.979388 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979296    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dskf4\""
Oct 29 23:13:09.979388 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979363    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dcbr2\""
Oct 29 23:13:09.979557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979444    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.979557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979465    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-b2b7x\""
Oct 29 23:13:09.979557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979499    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7rwfl\""
Oct 29 23:13:09.979557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979521    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-c96z8\""
Oct 29 23:13:09.979691 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.979563    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-h6cnq\""
Oct 29 23:13:09.983913 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.983896    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b-signing-key\") pod \"service-ca-5fffc97bdf-6brzf\" (UID: \"93f3ddb5-dfff-4606-84c8-8bb5ba8aef4b\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6brzf"
Oct 29 23:13:09.985041 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.985024    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.985081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.985032    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:09.986081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.986067    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a2bd555f-4524-41ef-900a-25b26103bec8-serving-cert\") pod \"console-operator-7cd56b8dbc-nd299\" (UID: \"a2bd555f-4524-41ef-900a-25b26103bec8\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:09.986197 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.986185    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-original-pull-secret\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:09.986255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.986240    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87f17a44-0885-45e5-81f1-300442c926b8-ovn-node-metrics-cert\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:09.987278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.987264    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3b6629b-dbda-44d0-8f3e-7e3d52f84632-agent-certs\") pod \"konnectivity-agent-8b26b\" (UID: \"a3b6629b-dbda-44d0-8f3e-7e3d52f84632\") " pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:13:09.988400 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.988385    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:09.988490 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:09.988464    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1e39db65-958e-48e5-9b21-38c452e8b00f-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-hknn2\" (UID: \"1e39db65-958e-48e5-9b21-38c452e8b00f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2"
Oct 29 23:13:10.029562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029496    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:10.029562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029529    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-lib-modules\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.029562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029547    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-system-cni-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029565    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-log-socket\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029591    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-socket-dir-parent\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029632    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-bin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029658    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-socket-dir-parent\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029677    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.029695    5044 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029727    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-bin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029700    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029758    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cnibin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029701    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-log-socket\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029697    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-lib-modules\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029635    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-system-cni-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.029781    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.529761486 +0000 UTC m=+1.841005792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:13:10.029790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029790    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.029813    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.529798934 +0000 UTC m=+1.841043241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029813    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-cnibin\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029844    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-hosts-file\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029879    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029896    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c228562a-e001-4c95-b864-719d90ae903f-crio-socket\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029913    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.029968    5044 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029970    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c228562a-e001-4c95-b864-719d90ae903f-crio-socket\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.029979    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2e00bed0-7bc2-4322-b108-efb74a2ee6cd-hosts-file\") pod \"node-resolver-lw2vc\" (UID: \"2e00bed0-7bc2-4322-b108-efb74a2ee6cd\") " pod="openshift-dns/node-resolver-lw2vc"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030051    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-systemd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.030068    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.53005633 +0000 UTC m=+1.841300632 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030078    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-systemd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030093    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-kubelet-config\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030131    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-conf-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030160    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-socket-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030189    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-kubelet-config\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030196    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030217    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-conf-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030231    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-node-log\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030256    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-socket-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030261    5044 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030276    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-node-log\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030258    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-etc-selinux\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.030322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030257    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-conf\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030351    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-conf\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030418    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030497    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030560    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030601    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/131528b2-b2fe-4d0d-9260-db245d108396-host-slash\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030619    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.030643    5044 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030685    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/131528b2-b2fe-4d0d-9260-db245d108396-host-slash\") pod \"iptables-alerter-zb2cb\" (UID: \"131528b2-b2fe-4d0d-9260-db245d108396\") " pod="openshift-network-operator/iptables-alerter-zb2cb"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.030702    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.530686729 +0000 UTC m=+1.841931035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030640    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-registration-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030702    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030691    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-registration-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030780    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysconfig\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030800    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-netd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030838    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-systemd-units\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030838    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysconfig\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030865    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-netd\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030895    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-systemd-units\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030872    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-modprobe-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030935    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-bin\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030959    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-netns\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030975    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-cni-bin\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030983    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-netns\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030961    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-modprobe-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.030987    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031022    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-kubernetes\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031042    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-multus\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031065    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-kubelet\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031112    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-cni-multus\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031111    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-kubelet\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031124    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-var-lib-kubelet\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031151    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-etc-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031153    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-kubernetes\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031177    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-system-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031177    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-etc-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031212    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-device-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031227    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-kubelet\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031231    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031255    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-system-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031279    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-run\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031306    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-hostroot\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031301    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-device-dir\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031323    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-run\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031281    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-multus-cni-dir\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031334    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031362    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-hostroot\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031366    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-slash\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.031354 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.031397    5044 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031413    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-k8s-cni-cncf-io\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.031430    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.531419295 +0000 UTC m=+1.842663602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031451    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-dbus\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031453    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-k8s-cni-cncf-io\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031456    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-slash\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031505    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf9cc14-3177-4dc4-8f45-ab8f230d185c-dbus\") pod \"global-pull-secret-syncer-l4dmt\" (UID: \"6cf9cc14-3177-4dc4-8f45-ab8f230d185c\") " pod="kube-system/global-pull-secret-syncer-l4dmt"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031529    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031549    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-sys\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031568    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-systemd\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031583    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-multus-certs\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031605    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-etc-kubernetes\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031629    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-sys\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031649    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cnibin\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031650    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031660    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-host-run-multus-certs\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031638    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-systemd\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031696    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7a7da2-cbef-4283-b2c2-3712e53aa9c6-cnibin\") pod \"multus-additional-cni-plugins-wzmpl\" (UID: \"9b7a7da2-cbef-4283-b2c2-3712e53aa9c6\") " pod="openshift-multus/multus-additional-cni-plugins-wzmpl"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031688    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031724    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031672    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9874f42-2ba3-4eba-af65-a6f114fcaaf6-etc-kubernetes\") pod \"multus-gcnnc\" (UID: \"e9874f42-2ba3-4eba-af65-a6f114fcaaf6\") " pod="openshift-multus/multus-gcnnc"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031743    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031785    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031780    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-ovn\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031830    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-run-ovn\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031833    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-var-lib-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031867    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-var-lib-openvswitch\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031866    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-sys-fs\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031908    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4d414a-b040-4e77-9ddf-a37d04677415-host\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031931    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-netns\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031966    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8e4d414a-b040-4e77-9ddf-a37d04677415-host\") pod \"node-ca-qcbhg\" (UID: \"8e4d414a-b040-4e77-9ddf-a37d04677415\") " pod="openshift-image-registry/node-ca-qcbhg"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031974    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5a83a964-ea7b-449e-8473-6677bf54e3b0-sys-fs\") pod \"aws-ebs-csi-driver-node-7wwzp\" (UID: \"5a83a964-ea7b-449e-8473-6677bf54e3b0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7wwzp"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.031979    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032026    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87f17a44-0885-45e5-81f1-300442c926b8-host-run-netns\") pod \"ovnkube-node-d7dc6\" (UID: \"87f17a44-0885-45e5-81f1-300442c926b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032067    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-var-lib-kubelet\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032096    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-host\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032126    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032151    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032146    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-etc-sysctl-d\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032195    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-var-lib-kubelet\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032258    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f4d2bad-866f-4398-9654-7f726d906f8d-host\") pod \"tuned-4wqmx\" (UID: \"0f4d2bad-866f-4398-9654-7f726d906f8d\") " pod="openshift-cluster-node-tuning-operator/tuned-4wqmx"
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.032268    5044 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.032387    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:10.532371482 +0000 UTC m=+1.843615785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:10.033510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.032774    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"image-registry-799bd4bb47-g7rsj\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") " pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:10.034978 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.033733    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/86d517f1-0115-4d62-983c-2ad7b98ebb94-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-tx897\" (UID: \"86d517f1-0115-4d62-983c-2ad7b98ebb94\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:10.034978 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.034411    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23297409-95e7-435a-8bca-d70d93ea2c09-metrics-certs\") pod \"network-metrics-daemon-dpbxx\" (UID: \"23297409-95e7-435a-8bca-d70d93ea2c09\") " pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:10.034978 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.034491    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f2e9e89c-8edc-48b1-a494-a265cd949867-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-dmlrk\" (UID: \"f2e9e89c-8edc-48b1-a494-a265cd949867\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:10.035069 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.035048    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"image-registry-6b87f698cd-z5z9k\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") " pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:10.121899 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.121864    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:10.160042 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.160015    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"
Oct 29 23:13:10.162125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.162106    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:10.162250 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.162231    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"
Oct 29 23:13:10.162300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.162290    5044 scope.go:122] "RemoveContainer" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d"
Oct 29 23:13:10.170138 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.167858    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dpbxx"
Oct 29 23:13:10.170716 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.170692    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:10.326276 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.326246    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:10.376440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.376412    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:10.485523 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.485404    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk"]
Oct 29 23:13:10.529467 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.529445    5044 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 29 23:13:10.536782 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.536759    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:10.536869 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.536801    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:10.536869 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.536857    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:10.536935 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.536870    5044 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:10.536935 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.536921    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:11.536907812 +0000 UTC m=+2.848152115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:10.537045 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.536940    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:10.537045 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.536965    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:10.537045 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.536970    5044 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:13:10.537045 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537008    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:11.537001976 +0000 UTC m=+2.848246278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:13:10.537045 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.536969    5044 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:13:10.537045 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537034    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:11.537028472 +0000 UTC m=+2.848272775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:13:10.537311 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537056    5044 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:13:10.537311 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537115    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:11.537099526 +0000 UTC m=+2.848343846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:13:10.537311 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537126    5044 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:10.537311 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.537150    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:10.537311 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537162    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:11.537149953 +0000 UTC m=+2.848394273 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:10.537311 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.537227    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:11.537216361 +0000 UTC m=+2.848460667 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:13:10.538622 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.538601    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b87f698cd-z5z9k"]
Oct 29 23:13:10.541928 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:10.541898    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e1c2a2_3edf_450a_9de0_ec803ff28569.slice/crio-9b4d41b02e671bafb490870ab4ee52f90046a3f85b7f01f60e91ae3a249f262b WatchSource:0}: Error finding container 9b4d41b02e671bafb490870ab4ee52f90046a3f85b7f01f60e91ae3a249f262b: Status 404 returned error can't find the container with id 9b4d41b02e671bafb490870ab4ee52f90046a3f85b7f01f60e91ae3a249f262b
Oct 29 23:13:10.544892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.544867    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:10.580369 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.580347    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj"]
Oct 29 23:13:10.583331 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:10.583307    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68b6b5d_44aa_4e94_b320_a669b4f09250.slice/crio-2b7c97ae8faa1b499711d92791e156b710ba07ae9e8d8cda9e24ce7b14575f7b WatchSource:0}: Error finding container 2b7c97ae8faa1b499711d92791e156b710ba07ae9e8d8cda9e24ce7b14575f7b: Status 404 returned error can't find the container with id 2b7c97ae8faa1b499711d92791e156b710ba07ae9e8d8cda9e24ce7b14575f7b
Oct 29 23:13:10.600456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.600433    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-tx897"]
Oct 29 23:13:10.606521 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:10.606500    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d517f1_0115_4d62_983c_2ad7b98ebb94.slice/crio-0595263201a822c14fac18001da5d70c476f3e490c3ea4bcc1f415dbc2d65e1d WatchSource:0}: Error finding container 0595263201a822c14fac18001da5d70c476f3e490c3ea4bcc1f415dbc2d65e1d: Status 404 returned error can't find the container with id 0595263201a822c14fac18001da5d70c476f3e490c3ea4bcc1f415dbc2d65e1d
Oct 29 23:13:10.626418 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.626397    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dpbxx"]
Oct 29 23:13:10.629190 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:10.629165    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23297409_95e7_435a_8bca_d70d93ea2c09.slice/crio-336907e5f66e64a4f6e8d09d926726201b20beef115776d7493f8c7c9d9a5592 WatchSource:0}: Error finding container 336907e5f66e64a4f6e8d09d926726201b20beef115776d7493f8c7c9d9a5592: Status 404 returned error can't find the container with id 336907e5f66e64a4f6e8d09d926726201b20beef115776d7493f8c7c9d9a5592
Oct 29 23:13:10.895889 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.895737    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk" event={"ID":"f2e9e89c-8edc-48b1-a494-a265cd949867","Type":"ContainerStarted","Data":"52c43896780fdce285729e5b31b9912a77e2c6e7792747813c190082baff800a"}
Oct 29 23:13:10.897648 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.897624    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:13:10.898093 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.898074    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/1.log"
Oct 29 23:13:10.898174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.898114    5044 generic.go:356] "Generic (PLEG): container finished" podID="a2bd555f-4524-41ef-900a-25b26103bec8" containerID="ce31344373a5ee6d9a6fb2c7a4c53b2ebca7ff27197474307307bc132cb6d201" exitCode=255
Oct 29 23:13:10.898230 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.898189    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" event={"ID":"a2bd555f-4524-41ef-900a-25b26103bec8","Type":"ContainerDied","Data":"ce31344373a5ee6d9a6fb2c7a4c53b2ebca7ff27197474307307bc132cb6d201"}
Oct 29 23:13:10.898283 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.898240    5044 scope.go:122] "RemoveContainer" containerID="8103723dac5528c4db49abe0a2e3c89083b3cac1ec38fe824748c5df3f37052d"
Oct 29 23:13:10.898670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.898651    5044 scope.go:122] "RemoveContainer" containerID="ce31344373a5ee6d9a6fb2c7a4c53b2ebca7ff27197474307307bc132cb6d201"
Oct 29 23:13:10.898907 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:10.898884    5044 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-nd299_openshift-console-operator(a2bd555f-4524-41ef-900a-25b26103bec8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" podUID="a2bd555f-4524-41ef-900a-25b26103bec8"
Oct 29 23:13:10.900324 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.900298    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897" event={"ID":"86d517f1-0115-4d62-983c-2ad7b98ebb94","Type":"ContainerStarted","Data":"0595263201a822c14fac18001da5d70c476f3e490c3ea4bcc1f415dbc2d65e1d"}
Oct 29 23:13:10.902132 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.901910    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k" event={"ID":"99e1c2a2-3edf-450a-9de0-ec803ff28569","Type":"ContainerStarted","Data":"4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be"}
Oct 29 23:13:10.902132 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.901948    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k" event={"ID":"99e1c2a2-3edf-450a-9de0-ec803ff28569","Type":"ContainerStarted","Data":"9b4d41b02e671bafb490870ab4ee52f90046a3f85b7f01f60e91ae3a249f262b"}
Oct 29 23:13:10.903237 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.903216    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpbxx" event={"ID":"23297409-95e7-435a-8bca-d70d93ea2c09","Type":"ContainerStarted","Data":"336907e5f66e64a4f6e8d09d926726201b20beef115776d7493f8c7c9d9a5592"}
Oct 29 23:13:10.904836 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.904761    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" event={"ID":"f68b6b5d-44aa-4e94-b320-a669b4f09250","Type":"ContainerStarted","Data":"51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466"}
Oct 29 23:13:10.904836 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.904806    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" event={"ID":"f68b6b5d-44aa-4e94-b320-a669b4f09250","Type":"ContainerStarted","Data":"2b7c97ae8faa1b499711d92791e156b710ba07ae9e8d8cda9e24ce7b14575f7b"}
Oct 29 23:13:10.972245 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:10.972213    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:11.382764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.382729    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:11.546748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.546711    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:11.546748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.546752    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:11.546993 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.546780    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:11.546993 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.546818    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:11.546993 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.546866    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:11.546993 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.546925    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:11.547209 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547070    5044 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 29 23:13:11.547209 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547129    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert podName:e00a2559-ea47-4bde-9c63-a175add6c791 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:13.547111261 +0000 UTC m=+4.858355588 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-qnzcj" (UID: "e00a2559-ea47-4bde-9c63-a175add6c791") : secret "networking-console-plugin-cert" not found
Oct 29 23:13:11.547209 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547180    5044 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:11.547364 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547213    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:13.54720186 +0000 UTC m=+4.858446177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:11.547364 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547273    5044 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:13:11.547364 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547306    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:13.547296298 +0000 UTC m=+4.858540605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:13:11.547557 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547371    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:13.547361694 +0000 UTC m=+4.858606014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:13:11.547557 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547413    5044 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:11.547557 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547440    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:13.547431686 +0000 UTC m=+4.858676003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:11.547557 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547532    5044 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:13:11.547692 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:11.547565    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:13.547555607 +0000 UTC m=+4.858799931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:13:11.715736 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.715683    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:11.910922 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.910840    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:13:11.913595 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.913574    5044 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 29 23:13:11.914457 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.914436    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpbxx" event={"ID":"23297409-95e7-435a-8bca-d70d93ea2c09","Type":"ContainerStarted","Data":"2a571d21c7aedfbe68365c5bb93ecfa23b6bff934b87173e105b37b41b049f4c"}
Oct 29 23:13:11.914546 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.914499    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dpbxx" event={"ID":"23297409-95e7-435a-8bca-d70d93ea2c09","Type":"ContainerStarted","Data":"966c32b5773fbf9695709da145a072a9ef713055520b865d22bc89b9fc1b0b58"}
Oct 29 23:13:11.914592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:11.914560    5044 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 29 23:13:12.118739 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.118703    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:12.308105 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.308067    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:12.509254 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.509224    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:12.716921 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.716830    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:12.923408 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.923368    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk" event={"ID":"f2e9e89c-8edc-48b1-a494-a265cd949867","Type":"ContainerStarted","Data":"c9a01e4b3e4b51ee477c612a14ca64f560603f32131846c15e540e3bad7fc2e8"}
Oct 29 23:13:12.923879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.923451    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-dmlrk" event={"ID":"f2e9e89c-8edc-48b1-a494-a265cd949867","Type":"ContainerStarted","Data":"1f485f88985e009f1ad4108fe0131a984ed51eae252ed0c2f0c956617c447d5a"}
Oct 29 23:13:12.925077 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.925049    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-tx897" event={"ID":"86d517f1-0115-4d62-983c-2ad7b98ebb94","Type":"ContainerStarted","Data":"003426382fa58d40b72ef0a6ab6a6b306a1341693592053349088bb94c9bb092"}
Oct 29 23:13:12.926517 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.926495    5044 generic.go:356] "Generic (PLEG): container finished" podID="2299d6c8-8676-4142-8744-a6869aa852fa" containerID="2560d35aaecee9fa82d24bb36d0dc3a195e9d03f4143c2b89401a55f648be156" exitCode=0
Oct 29 23:13:12.926607 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.926563    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-f8sqw" event={"ID":"2299d6c8-8676-4142-8744-a6869aa852fa","Type":"ContainerDied","Data":"2560d35aaecee9fa82d24bb36d0dc3a195e9d03f4143c2b89401a55f648be156"}
Oct 29 23:13:12.926985 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:12.926967    5044 scope.go:122] "RemoveContainer" containerID="2560d35aaecee9fa82d24bb36d0dc3a195e9d03f4143c2b89401a55f648be156"
Oct 29 23:13:13.043611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.043574    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:13.201125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.201080    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:13.484924 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.484892    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:13.546427 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.546398    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:13.546703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.546687    5044 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 29 23:13:13.568097 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.568071    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:13.568267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.568121    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:13.568267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.568169    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:13.568267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.568188    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:13.568267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.568209    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:13.568267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.568239    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:13.568267 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568240    5044 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568278    5044 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568309    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls podName:2ebf8680-3179-4d73-abac-d53520204010 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:17.568290134 +0000 UTC m=+8.879534459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls") pod "dns-default-f8lst" (UID: "2ebf8680-3179-4d73-abac-d53520204010") : secret "dns-default-metrics-tls" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568310    5044 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568338    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:17.568327379 +0000 UTC m=+8.879571700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : secret "insights-runtime-extractor-tls" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568353    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm podName:c228562a-e001-4c95-b864-719d90ae903f nodeName:}" failed. No retries permitted until 2026-10-29 23:13:17.568345543 +0000 UTC m=+8.879589851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sgk28" (UID: "c228562a-e001-4c95-b864-719d90ae903f") : configmap "kube-rbac-proxy" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568356    5044 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 29 23:13:13.568523 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568400    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:17.568384862 +0000 UTC m=+8.879629181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : secret "router-metrics-certs-default" not found
Oct 29 23:13:13.568768 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:13.568538    5044 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle podName:7f0c3a6a-b4fb-469f-9837-2f010a013a49 nodeName:}" failed. No retries permitted until 2026-10-29 23:13:17.568471755 +0000 UTC m=+8.879716063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle") pod "router-default-5d7cd8c56f-8gsnl" (UID: "7f0c3a6a-b4fb-469f-9837-2f010a013a49") : configmap references non-existent config key: service-ca.crt
Oct 29 23:13:13.570448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.570430    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e00a2559-ea47-4bde-9c63-a175add6c791-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-qnzcj\" (UID: \"e00a2559-ea47-4bde-9c63-a175add6c791\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:13.663914 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.663880    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:13.763346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.763264    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"
Oct 29 23:13:13.913610 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.913569    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:13.931216 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.931188    5044 generic.go:356] "Generic (PLEG): container finished" podID="1e39db65-958e-48e5-9b21-38c452e8b00f" containerID="c183e49039b6daa67a984d3d2fb56fcb1a2b09a7b1dcb48f3fca5ddbfd2369c8" exitCode=0
Oct 29 23:13:13.931645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.931273    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2" event={"ID":"1e39db65-958e-48e5-9b21-38c452e8b00f","Type":"ContainerDied","Data":"c183e49039b6daa67a984d3d2fb56fcb1a2b09a7b1dcb48f3fca5ddbfd2369c8"}
Oct 29 23:13:13.931683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.931666    5044 scope.go:122] "RemoveContainer" containerID="c183e49039b6daa67a984d3d2fb56fcb1a2b09a7b1dcb48f3fca5ddbfd2369c8"
Oct 29 23:13:13.933380 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:13.933357    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-f8sqw" event={"ID":"2299d6c8-8676-4142-8744-a6869aa852fa","Type":"ContainerStarted","Data":"c65916480c2d8c5d40654e275fc053785c188351dad358758825d2f5bec3ba88"}
Oct 29 23:13:14.059955 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.059878    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-qnzcj"]
Oct 29 23:13:14.063368 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:14.063343    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode00a2559_ea47_4bde_9c63_a175add6c791.slice/crio-6c6b8d22fc759501b45bcba52868a9f6cca6462d28b949e93b034e42968de959 WatchSource:0}: Error finding container 6c6b8d22fc759501b45bcba52868a9f6cca6462d28b949e93b034e42968de959: Status 404 returned error can't find the container with id 6c6b8d22fc759501b45bcba52868a9f6cca6462d28b949e93b034e42968de959
Oct 29 23:13:14.142347 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.142314    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:14.315312 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.315220    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:14.527197 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.527163    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:14.721691 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.721666    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:14.878934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.878891    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:14.938076 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.938042    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj" event={"ID":"e00a2559-ea47-4bde-9c63-a175add6c791","Type":"ContainerStarted","Data":"6c6b8d22fc759501b45bcba52868a9f6cca6462d28b949e93b034e42968de959"}
Oct 29 23:13:14.943759 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:14.943731    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-hknn2" event={"ID":"1e39db65-958e-48e5-9b21-38c452e8b00f","Type":"ContainerStarted","Data":"f9f6bdf77824ba605eeda4a38e7cc3654d28553668201359c9828e3877f17aff"}
Oct 29 23:13:15.941603 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:15.941566    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:15.950779 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:15.950748    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-qnzcj" event={"ID":"e00a2559-ea47-4bde-9c63-a175add6c791","Type":"ContainerStarted","Data":"7f97788c98d69121d6c627f35358bccd5cc2b762e63afaaa6346622f88be21aa"}
Oct 29 23:13:16.150532 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:16.150496    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:16.326946 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:16.326913    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:16.536194 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:16.536157    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:16.733023 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:16.732988    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:17.129737 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.129649    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:17.133535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.133507    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:17.415843 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.415760    5044 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:17.416127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.416112    5044 scope.go:122] "RemoveContainer" containerID="ce31344373a5ee6d9a6fb2c7a4c53b2ebca7ff27197474307307bc132cb6d201"
Oct 29 23:13:17.416311 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:17.416292    5044 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-nd299_openshift-console-operator(a2bd555f-4524-41ef-900a-25b26103bec8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" podUID="a2bd555f-4524-41ef-900a-25b26103bec8"
Oct 29 23:13:17.451995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.451961    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:17.606510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.606458    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:17.606692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.606517    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:17.606692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.606550    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:17.606692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.606576    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:17.606692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.606611    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:17.607122 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.607096    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c228562a-e001-4c95-b864-719d90ae903f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:17.607321 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.607298    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f0c3a6a-b4fb-469f-9837-2f010a013a49-service-ca-bundle\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:17.608774 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.608752    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c228562a-e001-4c95-b864-719d90ae903f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sgk28\" (UID: \"c228562a-e001-4c95-b864-719d90ae903f\") " pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:17.608957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.608937    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2ebf8680-3179-4d73-abac-d53520204010-metrics-tls\") pod \"dns-default-f8lst\" (UID: \"2ebf8680-3179-4d73-abac-d53520204010\") " pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:17.609013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.608999    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7f0c3a6a-b4fb-469f-9837-2f010a013a49-metrics-certs\") pod \"router-default-5d7cd8c56f-8gsnl\" (UID: \"7f0c3a6a-b4fb-469f-9837-2f010a013a49\") " pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:17.661004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.660979    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:17.674865 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.674845    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:17.674956 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.674932    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sgk28"
Oct 29 23:13:17.971573 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.971542    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5d7cd8c56f-8gsnl"]
Oct 29 23:13:17.976066 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:17.976035    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f0c3a6a_b4fb_469f_9837_2f010a013a49.slice/crio-fe61e10a11ea1128782c16d293752fcaed3e0cb8d34bc527768de8a5e7ada630 WatchSource:0}: Error finding container fe61e10a11ea1128782c16d293752fcaed3e0cb8d34bc527768de8a5e7ada630: Status 404 returned error can't find the container with id fe61e10a11ea1128782c16d293752fcaed3e0cb8d34bc527768de8a5e7ada630
Oct 29 23:13:17.988009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.987988    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sgk28"]
Oct 29 23:13:17.990747 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:17.990723    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc228562a_e001_4c95_b864_719d90ae903f.slice/crio-b059ca14399bf9d782bac8b3fe4c88e435f02db726308e749555af07b3329c3b WatchSource:0}: Error finding container b059ca14399bf9d782bac8b3fe4c88e435f02db726308e749555af07b3329c3b: Status 404 returned error can't find the container with id b059ca14399bf9d782bac8b3fe4c88e435f02db726308e749555af07b3329c3b
Oct 29 23:13:17.992906 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:17.992881    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f8lst"]
Oct 29 23:13:18.004535 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:18.004511    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ebf8680_3179_4d73_abac_d53520204010.slice/crio-d29a1b2d1fc7a95d01a22d20c7a0a723a33514c03506ccde3e29039ef63ad771 WatchSource:0}: Error finding container d29a1b2d1fc7a95d01a22d20c7a0a723a33514c03506ccde3e29039ef63ad771: Status 404 returned error can't find the container with id d29a1b2d1fc7a95d01a22d20c7a0a723a33514c03506ccde3e29039ef63ad771
Oct 29 23:13:18.837650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.837620    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:18.965240 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.965158    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgk28" event={"ID":"c228562a-e001-4c95-b864-719d90ae903f","Type":"ContainerStarted","Data":"0fa9d81fded90faa81554fc6301ea771e4ee0b558b335c26b0adc9357062b333"}
Oct 29 23:13:18.965240 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.965226    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgk28" event={"ID":"c228562a-e001-4c95-b864-719d90ae903f","Type":"ContainerStarted","Data":"1a00ed45759e0868b6f7bd384f54e3f2536b542ca770c2f4f9f43291b8abe582"}
Oct 29 23:13:18.965453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.965256    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgk28" event={"ID":"c228562a-e001-4c95-b864-719d90ae903f","Type":"ContainerStarted","Data":"b059ca14399bf9d782bac8b3fe4c88e435f02db726308e749555af07b3329c3b"}
Oct 29 23:13:18.970783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.970755    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl" event={"ID":"7f0c3a6a-b4fb-469f-9837-2f010a013a49","Type":"ContainerStarted","Data":"ad27c09eea1f1f5795b70b7f291188b15d96b9a0061722b475d84129deabf4c3"}
Oct 29 23:13:18.970921 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.970802    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl" event={"ID":"7f0c3a6a-b4fb-469f-9837-2f010a013a49","Type":"ContainerStarted","Data":"fe61e10a11ea1128782c16d293752fcaed3e0cb8d34bc527768de8a5e7ada630"}
Oct 29 23:13:18.972497 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:18.972451    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8lst" event={"ID":"2ebf8680-3179-4d73-abac-d53520204010","Type":"ContainerStarted","Data":"d29a1b2d1fc7a95d01a22d20c7a0a723a33514c03506ccde3e29039ef63ad771"}
Oct 29 23:13:19.662176 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.662113    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:19.664944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.664919    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:19.926359 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.926271    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:19.926843 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.926760    5044 scope.go:122] "RemoveContainer" containerID="ce31344373a5ee6d9a6fb2c7a4c53b2ebca7ff27197474307307bc132cb6d201"
Oct 29 23:13:19.927008 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:19.926988    5044 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-nd299_openshift-console-operator(a2bd555f-4524-41ef-900a-25b26103bec8)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" podUID="a2bd555f-4524-41ef-900a-25b26103bec8"
Oct 29 23:13:19.979615 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.979579    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8lst" event={"ID":"2ebf8680-3179-4d73-abac-d53520204010","Type":"ContainerStarted","Data":"27f7c3cedcdbc9f968ccda465e37dd9918b59ecde55e509e2e2d674ad8bebbd5"}
Oct 29 23:13:19.979798 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.979648    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f8lst" event={"ID":"2ebf8680-3179-4d73-abac-d53520204010","Type":"ContainerStarted","Data":"d393440f81395bafbb08b8f658b984214058e4cbef36fa3655e515e06592dfb9"}
Oct 29 23:13:19.979885 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:19.979870    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:20.104575 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.104542    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:20.379792 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.379767    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8b26b"
Oct 29 23:13:20.813605 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.813579    5044 scope.go:122] "RemoveContainer" containerID="ce31344373a5ee6d9a6fb2c7a4c53b2ebca7ff27197474307307bc132cb6d201"
Oct 29 23:13:20.986366 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.986324    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sgk28" event={"ID":"c228562a-e001-4c95-b864-719d90ae903f","Type":"ContainerStarted","Data":"4b9587773eabe7c1779ceb6a08c36f65ed5bedc6f2a59b021c2a8401b5717522"}
Oct 29 23:13:20.988368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.988348    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:13:20.988505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.988465    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299" event={"ID":"a2bd555f-4524-41ef-900a-25b26103bec8","Type":"ContainerStarted","Data":"346e9f7a640f7f35453c18d71475be48e94b5df4a1c461c58e5b0cb8c894e6ba"}
Oct 29 23:13:20.988711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:20.988682    5044 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 29 23:13:21.797629 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:21.797594    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:21.959121 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:21.959087    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:22.122759 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.122671    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:22.323834 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.323790    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:22.476102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.476071    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:22.613254 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.613224    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:22.659303 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.659273    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:22.659466 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.659393    5044 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 29 23:13:22.660565 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:22.660541    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5d7cd8c56f-8gsnl"
Oct 29 23:13:24.415987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:24.415948    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:24.554198 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:24.554157    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:26.351608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.351580    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-w2d6w-lw5ns"]
Oct 29 23:13:26.357812 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.357785    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.382647 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.382623    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-w2d6w-lw5ns"]
Oct 29 23:13:26.386867 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.386839    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"]
Oct 29 23:13:26.390109 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.390087    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:26.410338 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.410282    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b87f698cd-z5z9k"]
Oct 29 23:13:26.415536 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.415505    5044 patch_prober.go:29] interesting pod/image-registry-6b87f698cd-z5z9k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 29 23:13:26.415646 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.415563    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k" podUID="99e1c2a2-3edf-450a-9de0-ec803ff28569" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:13:26.425502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.425465    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Oct 29 23:13:26.425645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.425628    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mvh5r\""
Oct 29 23:13:26.444706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.444682    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"]
Oct 29 23:13:26.492949 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.492912    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.493133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.492955    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.493133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.493064    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw5qx\" (UniqueName: \"kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.493133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.493115    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-gqkft\" (UID: \"f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:26.493265 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.493177    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.501281 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.501252    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-j8fs4"]
Oct 29 23:13:26.504897 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.504880    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-cfcc55999-2vhks"]
Oct 29 23:13:26.505021 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.505007    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.508014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.507996    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.541313 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.541288    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 29 23:13:26.541545 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.541531    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 29 23:13:26.551795 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.551776    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-s2bzj\""
Oct 29 23:13:26.556593 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.556572    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfcc55999-2vhks"]
Oct 29 23:13:26.557822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.557802    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-j8fs4"]
Oct 29 23:13:26.594524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594490    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw5qx\" (UniqueName: \"kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.594665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594535    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwg7b\" (UniqueName: \"kubernetes.io/projected/95feb768-13af-4cae-ad0e-6b797cfbe9a0-kube-api-access-jwg7b\") pod \"downloads-6dd789c8b7-j8fs4\" (UID: \"95feb768-13af-4cae-ad0e-6b797cfbe9a0\") " pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.594665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594566    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-gqkft\" (UID: \"f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:26.594665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594581    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.594665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594607    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95feb768-13af-4cae-ad0e-6b797cfbe9a0-tmp\") pod \"downloads-6dd789c8b7-j8fs4\" (UID: \"95feb768-13af-4cae-ad0e-6b797cfbe9a0\") " pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.594665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594646    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.594904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.594871    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.595168 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.595135    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.595436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.595416    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.595705 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.595687    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.597122 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.597099    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-gqkft\" (UID: \"f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:26.620169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.620111    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw5qx\" (UniqueName: \"kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx\") pod \"periodic-gathering-w2d6w-lw5ns\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") " pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.669754 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.669728    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:13:26.696392 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696358    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5730de6c-aa05-4430-b787-22d502b543b7-image-registry-private-configuration\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696419    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-bound-sa-token\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696454    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5730de6c-aa05-4430-b787-22d502b543b7-ca-trust-extracted\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696550    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d8bb\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-kube-api-access-4d8bb\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696604    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwg7b\" (UniqueName: \"kubernetes.io/projected/95feb768-13af-4cae-ad0e-6b797cfbe9a0-kube-api-access-jwg7b\") pod \"downloads-6dd789c8b7-j8fs4\" (UID: \"95feb768-13af-4cae-ad0e-6b797cfbe9a0\") " pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.696685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696638    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5730de6c-aa05-4430-b787-22d502b543b7-installation-pull-secrets\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696670    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5730de6c-aa05-4430-b787-22d502b543b7-trusted-ca\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696760 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696693    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95feb768-13af-4cae-ad0e-6b797cfbe9a0-tmp\") pod \"downloads-6dd789c8b7-j8fs4\" (UID: \"95feb768-13af-4cae-ad0e-6b797cfbe9a0\") " pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.696760 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696709    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5730de6c-aa05-4430-b787-22d502b543b7-registry-certificates\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.696859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696836    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-registry-tls\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.697002 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.696987    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95feb768-13af-4cae-ad0e-6b797cfbe9a0-tmp\") pod \"downloads-6dd789c8b7-j8fs4\" (UID: \"95feb768-13af-4cae-ad0e-6b797cfbe9a0\") " pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.702228 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.702215    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:26.730956 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.730920    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:26.736601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.736544    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwg7b\" (UniqueName: \"kubernetes.io/projected/95feb768-13af-4cae-ad0e-6b797cfbe9a0-kube-api-access-jwg7b\") pod \"downloads-6dd789c8b7-j8fs4\" (UID: \"95feb768-13af-4cae-ad0e-6b797cfbe9a0\") " pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.797536 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797501    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5730de6c-aa05-4430-b787-22d502b543b7-image-registry-private-configuration\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797567    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-bound-sa-token\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797609    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5730de6c-aa05-4430-b787-22d502b543b7-ca-trust-extracted\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797769 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797654    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d8bb\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-kube-api-access-4d8bb\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797769 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797695    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5730de6c-aa05-4430-b787-22d502b543b7-installation-pull-secrets\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797769 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797735    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5730de6c-aa05-4430-b787-22d502b543b7-trusted-ca\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797908 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797775    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5730de6c-aa05-4430-b787-22d502b543b7-registry-certificates\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.797908 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.797814    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-registry-tls\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.798074 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.798041    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5730de6c-aa05-4430-b787-22d502b543b7-ca-trust-extracted\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.798775 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.798746    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5730de6c-aa05-4430-b787-22d502b543b7-registry-certificates\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.798901 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.798863    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5730de6c-aa05-4430-b787-22d502b543b7-trusted-ca\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.800110 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.800082    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5730de6c-aa05-4430-b787-22d502b543b7-image-registry-private-configuration\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.800323 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.800303    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-registry-tls\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.800989 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.800973    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5730de6c-aa05-4430-b787-22d502b543b7-installation-pull-secrets\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.817233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.817210    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:26.817555 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.817535    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-bound-sa-token\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.818228 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.818210    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d8bb\" (UniqueName: \"kubernetes.io/projected/5730de6c-aa05-4430-b787-22d502b543b7-kube-api-access-4d8bb\") pod \"image-registry-cfcc55999-2vhks\" (UID: \"5730de6c-aa05-4430-b787-22d502b543b7\") " pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.823219 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.823199    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:26.970946 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:26.970918    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-w2d6w-lw5ns"]
Oct 29 23:13:26.974003 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:26.973973    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a578bd_8156_4601_8d0f_eba1dcffa139.slice/crio-656ff9899f2b26e0e0cf22d05a3729dba3f709bb096001119deb59c6fadb679d WatchSource:0}: Error finding container 656ff9899f2b26e0e0cf22d05a3729dba3f709bb096001119deb59c6fadb679d: Status 404 returned error can't find the container with id 656ff9899f2b26e0e0cf22d05a3729dba3f709bb096001119deb59c6fadb679d
Oct 29 23:13:27.019377 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:27.019351    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns" event={"ID":"42a578bd-8156-4601-8d0f-eba1dcffa139","Type":"ContainerStarted","Data":"656ff9899f2b26e0e0cf22d05a3729dba3f709bb096001119deb59c6fadb679d"}
Oct 29 23:13:27.037556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:27.037513    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"]
Oct 29 23:13:27.039694 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:27.039670    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf573fdc2_667e_49f6_9ec8_6a0bbeb23ebf.slice/crio-74a876539feca1989bbde5092b6017fbde9fc12e96a869e74efb6a09df48a0f7 WatchSource:0}: Error finding container 74a876539feca1989bbde5092b6017fbde9fc12e96a869e74efb6a09df48a0f7: Status 404 returned error can't find the container with id 74a876539feca1989bbde5092b6017fbde9fc12e96a869e74efb6a09df48a0f7
Oct 29 23:13:27.083519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:27.083471    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:27.119155 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:27.119126    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-j8fs4"]
Oct 29 23:13:27.121308 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:27.121278    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95feb768_13af_4cae_ad0e_6b797cfbe9a0.slice/crio-50367f3668e9e0415eff4a544010da98082ac415ca8f1ea7d899c1d8d5eadec6 WatchSource:0}: Error finding container 50367f3668e9e0415eff4a544010da98082ac415ca8f1ea7d899c1d8d5eadec6: Status 404 returned error can't find the container with id 50367f3668e9e0415eff4a544010da98082ac415ca8f1ea7d899c1d8d5eadec6
Oct 29 23:13:27.142274 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:27.142249    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-cfcc55999-2vhks"]
Oct 29 23:13:27.145923 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:27.145894    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5730de6c_aa05_4430_b787_22d502b543b7.slice/crio-bfb6304764be48f353b0ad02a446b324e3913216db26361ea3433694c23b3f76 WatchSource:0}: Error finding container bfb6304764be48f353b0ad02a446b324e3913216db26361ea3433694c23b3f76: Status 404 returned error can't find the container with id bfb6304764be48f353b0ad02a446b324e3913216db26361ea3433694c23b3f76
Oct 29 23:13:27.256637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:27.256605    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:28.026270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.026234    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-j8fs4" event={"ID":"95feb768-13af-4cae-ad0e-6b797cfbe9a0","Type":"ContainerStarted","Data":"50367f3668e9e0415eff4a544010da98082ac415ca8f1ea7d899c1d8d5eadec6"}
Oct 29 23:13:28.028130 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.028093    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns" event={"ID":"42a578bd-8156-4601-8d0f-eba1dcffa139","Type":"ContainerStarted","Data":"221cc4e233a94dbb9e54eefd7b8b5a11bc60f4f29ce2083e5f99ac24d04626dc"}
Oct 29 23:13:28.030347 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.030319    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfcc55999-2vhks" event={"ID":"5730de6c-aa05-4430-b787-22d502b543b7","Type":"ContainerStarted","Data":"4f31145e0e80f6b65cc524facdfcc851f313bcbb521e66b3b03f05b7e61d4152"}
Oct 29 23:13:28.030462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.030370    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:28.030462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.030395    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-cfcc55999-2vhks" event={"ID":"5730de6c-aa05-4430-b787-22d502b543b7","Type":"ContainerStarted","Data":"bfb6304764be48f353b0ad02a446b324e3913216db26361ea3433694c23b3f76"}
Oct 29 23:13:28.031720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.031694    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft" event={"ID":"f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf","Type":"ContainerStarted","Data":"74a876539feca1989bbde5092b6017fbde9fc12e96a869e74efb6a09df48a0f7"}
Oct 29 23:13:28.064050 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.063995    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns" podStartSLOduration=2.063984171 podStartE2EDuration="2.063984171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:28.062932666 +0000 UTC m=+19.374176994" watchObservedRunningTime="2026-10-29 23:13:28.063984171 +0000 UTC m=+19.375228487"
Oct 29 23:13:28.101149 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.101097    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-cfcc55999-2vhks" podStartSLOduration=2.101062056 podStartE2EDuration="2.101062056s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:28.100320656 +0000 UTC m=+19.411564984" watchObservedRunningTime="2026-10-29 23:13:28.101062056 +0000 UTC m=+19.412306378"
Oct 29 23:13:28.431327 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.431233    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:28.569973 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.569937    5044 patch_prober.go:29] interesting pod/image-registry-799bd4bb47-g7rsj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 29 23:13:28.570147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.569993    5044 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:13:28.595806 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.595773    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:28.843440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.843397    5044 patch_prober.go:29] interesting pod/image-registry-799bd4bb47-g7rsj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 29 23:13:28.843623 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:28.843445    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:13:29.038650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.038607    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft" event={"ID":"f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf","Type":"ContainerStarted","Data":"b52e3897afa8fc1f8a9cf0edbdd77f7e84f226c5e3d3585ae0f8044d072eae7e"}
Oct 29 23:13:29.039135 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.039113    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:29.045680 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.045658    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft"
Oct 29 23:13:29.073212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.073170    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-gqkft" podStartSLOduration=1.996955029 podStartE2EDuration="3.073158822s" totalImagesPullingTime="1.076203793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:29.072719585 +0000 UTC m=+20.383963910" watchObservedRunningTime="2026-10-29 23:13:29.073158822 +0000 UTC m=+20.384403145"
Oct 29 23:13:29.382606 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.382535    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7dc6"
Oct 29 23:13:29.586132 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.586035    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:29.667112 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.667061    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"]
Oct 29 23:13:29.671231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.671210    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.691146 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.691117    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 29 23:13:29.691270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.691234    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 29 23:13:29.691270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.691238    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bxqlj\""
Oct 29 23:13:29.693270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.693252    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 29 23:13:29.714046 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.714018    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"]
Oct 29 23:13:29.786249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.786213    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:29.824665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.824628    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53686b8f-158b-4426-bb95-c80781ba7dd2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.824813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.824670    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53686b8f-158b-4426-bb95-c80781ba7dd2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.824813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.824690    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53686b8f-158b-4426-bb95-c80781ba7dd2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.824813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.824742    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw8qr\" (UniqueName: \"kubernetes.io/projected/53686b8f-158b-4426-bb95-c80781ba7dd2-kube-api-access-kw8qr\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.925632 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.925547    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53686b8f-158b-4426-bb95-c80781ba7dd2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.925632 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.925594    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53686b8f-158b-4426-bb95-c80781ba7dd2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.926047 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.926004    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53686b8f-158b-4426-bb95-c80781ba7dd2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.926147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.926131    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw8qr\" (UniqueName: \"kubernetes.io/projected/53686b8f-158b-4426-bb95-c80781ba7dd2-kube-api-access-kw8qr\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.926519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.926465    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/53686b8f-158b-4426-bb95-c80781ba7dd2-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.928515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.928465    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/53686b8f-158b-4426-bb95-c80781ba7dd2-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.928703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.928682    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/53686b8f-158b-4426-bb95-c80781ba7dd2-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.945065 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.945044    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw8qr\" (UniqueName: \"kubernetes.io/projected/53686b8f-158b-4426-bb95-c80781ba7dd2-kube-api-access-kw8qr\") pod \"prometheus-operator-9cd89b74c-2f6l2\" (UID: \"53686b8f-158b-4426-bb95-c80781ba7dd2\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.987644 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.987617    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"
Oct 29 23:13:29.991082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:29.990823    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f8lst"
Oct 29 23:13:30.059331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:30.059302    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:30.284520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:30.284438    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2"]
Oct 29 23:13:30.287208 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:30.287182    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53686b8f_158b_4426_bb95_c80781ba7dd2.slice/crio-c361f0fd61f94b1b72ad834e734f11393a7c3b10181625d8ee988fe24ac6351a WatchSource:0}: Error finding container c361f0fd61f94b1b72ad834e734f11393a7c3b10181625d8ee988fe24ac6351a: Status 404 returned error can't find the container with id c361f0fd61f94b1b72ad834e734f11393a7c3b10181625d8ee988fe24ac6351a
Oct 29 23:13:30.989927 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:30.989894    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:30.994956 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:30.994931    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-nd299"
Oct 29 23:13:31.057767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:31.057720    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2" event={"ID":"53686b8f-158b-4426-bb95-c80781ba7dd2","Type":"ContainerStarted","Data":"c361f0fd61f94b1b72ad834e734f11393a7c3b10181625d8ee988fe24ac6351a"}
Oct 29 23:13:31.828294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:31.828258    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8lst_2ebf8680-3179-4d73-abac-d53520204010/dns/0.log"
Oct 29 23:13:32.029742 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.029668    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8lst_2ebf8680-3179-4d73-abac-d53520204010/kube-rbac-proxy/0.log"
Oct 29 23:13:32.064859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.064820    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2" event={"ID":"53686b8f-158b-4426-bb95-c80781ba7dd2","Type":"ContainerStarted","Data":"74079c67386b15144701b456456d3a3131669fd07ab0220a3e19c3c90c972342"}
Oct 29 23:13:32.065038 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.064888    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2" event={"ID":"53686b8f-158b-4426-bb95-c80781ba7dd2","Type":"ContainerStarted","Data":"75bb71fec6a4feba7441ec6838a30b180d1e0d2e53da2a77c5283cd490bebb4a"}
Oct 29 23:13:32.106932 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.106687    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-2f6l2" podStartSLOduration=1.934790428 podStartE2EDuration="3.106668744s" totalImagesPullingTime="1.171878316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:32.104774884 +0000 UTC m=+23.416019208" watchObservedRunningTime="2026-10-29 23:13:32.106668744 +0000 UTC m=+23.417913070"
Oct 29 23:13:32.428236 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.428172    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw2vc_2e00bed0-7bc2-4322-b108-efb74a2ee6cd/dns-node-resolver/0.log"
Oct 29 23:13:32.456544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.456441    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:32.826880 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:32.826851    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6b87f698cd-z5z9k_99e1c2a2-3edf-450a-9de0-ec803ff28569/registry/0.log"
Oct 29 23:13:33.028007 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:33.027975    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-799bd4bb47-g7rsj_f68b6b5d-44aa-4e94-b320-a669b4f09250/registry/0.log"
Oct 29 23:13:33.227643 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:33.227613    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-cfcc55999-2vhks_5730de6c-aa05-4430-b787-22d502b543b7/registry/0.log"
Oct 29 23:13:33.467980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:33.467945    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:33.636448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:33.636356    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:33.826391 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:33.826367    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qcbhg_8e4d414a-b040-4e77-9ddf-a37d04677415/node-ca/0.log"
Oct 29 23:13:34.035079 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.035036    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:13:34.112348 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.112266    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:34.227018 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.226984    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vqvz7_b3d008fa-a5ed-4811-8ed3-ba9193e7eff6/serve-healthcheck-canary/0.log"
Oct 29 23:13:34.293300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.293219    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:34.470458 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.470350    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:34.507154 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.507121    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ctxl4"]
Oct 29 23:13:34.547946 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.547875    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.560761 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.560733    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.560880 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.560775    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.560880 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.560856    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-sys\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.560994 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.560927    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-textfile\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.561043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.561026    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-tls\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.561091 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.561077    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-root\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.561144 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.561108    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-wtmp\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.561254 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.561228    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb76746d-f3e8-418e-9d22-092d236c2a7d-metrics-client-ca\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.561302 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.561274    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5ft5\" (UniqueName: \"kubernetes.io/projected/eb76746d-f3e8-418e-9d22-092d236c2a7d-kube-api-access-z5ft5\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.651268 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.651236    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 29 23:13:34.657684 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.657644    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6s7px\""
Oct 29 23:13:34.657684 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.657665    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 29 23:13:34.657872 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.657717    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 29 23:13:34.662205 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662174    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-root\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662217    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-wtmp\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662242    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb76746d-f3e8-418e-9d22-092d236c2a7d-metrics-client-ca\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662266    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5ft5\" (UniqueName: \"kubernetes.io/projected/eb76746d-f3e8-418e-9d22-092d236c2a7d-kube-api-access-z5ft5\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662319    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662346    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662365    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-root\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662385    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-sys\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662408    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-textfile\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662461    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-tls\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662863 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662386    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-wtmp\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662863 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662692    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb76746d-f3e8-418e-9d22-092d236c2a7d-sys\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662963 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662878    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-textfile\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.662963 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662920    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb76746d-f3e8-418e-9d22-092d236c2a7d-metrics-client-ca\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.663066 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.662956    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-accelerators-collector-config\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.665126 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.665103    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.665272 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.665250    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/eb76746d-f3e8-418e-9d22-092d236c2a7d-node-exporter-tls\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.675693 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.675584    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:34.683255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.683233    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5ft5\" (UniqueName: \"kubernetes.io/projected/eb76746d-f3e8-418e-9d22-092d236c2a7d-kube-api-access-z5ft5\") pod \"node-exporter-ctxl4\" (UID: \"eb76746d-f3e8-418e-9d22-092d236c2a7d\") " pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.856098 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.855991    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:34.920889 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:34.920857    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ctxl4"
Oct 29 23:13:34.953435 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:13:34.953401    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb76746d_f3e8_418e_9d22_092d236c2a7d.slice/crio-f1a7c20c75352455ee66b0b573d8a40a7347b3a324d9693e45be5e6a39dd827b WatchSource:0}: Error finding container f1a7c20c75352455ee66b0b573d8a40a7347b3a324d9693e45be5e6a39dd827b: Status 404 returned error can't find the container with id f1a7c20c75352455ee66b0b573d8a40a7347b3a324d9693e45be5e6a39dd827b
Oct 29 23:13:35.014952 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:35.014922    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:35.082922 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:35.082881    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctxl4" event={"ID":"eb76746d-f3e8-418e-9d22-092d236c2a7d","Type":"ContainerStarted","Data":"f1a7c20c75352455ee66b0b573d8a40a7347b3a324d9693e45be5e6a39dd827b"}
Oct 29 23:13:35.229258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:35.229225    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:35.576259 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:35.576156    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:35.742953 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:35.742916    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:35.964233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:35.964159    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:36.160236 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:36.160147    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:36.416002 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:36.415968    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:37.096136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:37.096062    5044 generic.go:356] "Generic (PLEG): container finished" podID="eb76746d-f3e8-418e-9d22-092d236c2a7d" containerID="7ba702c21eff79ad1f18f6d40768e4e9cdb618488af2333f03b5ef175e14b4ab" exitCode=0
Oct 29 23:13:37.096136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:37.096113    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctxl4" event={"ID":"eb76746d-f3e8-418e-9d22-092d236c2a7d","Type":"ContainerDied","Data":"7ba702c21eff79ad1f18f6d40768e4e9cdb618488af2333f03b5ef175e14b4ab"}
Oct 29 23:13:37.745916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:37.745876    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:37.941343 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:37.941287    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:38.104009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:38.103930    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctxl4" event={"ID":"eb76746d-f3e8-418e-9d22-092d236c2a7d","Type":"ContainerStarted","Data":"f665b617a7ce2d0b9206dcdce74f5af7039e67dbdb399a31d8a3a77e223c7b44"}
Oct 29 23:13:38.104009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:38.103993    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ctxl4" event={"ID":"eb76746d-f3e8-418e-9d22-092d236c2a7d","Type":"ContainerStarted","Data":"bf24e386263bfccc4b41576008e4bd2c4f9d95175fe0a5d0d3e305bb3bac6438"}
Oct 29 23:13:38.152096 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:38.152038    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:38.169901 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:38.169847    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ctxl4" podStartSLOduration=2.5021940860000003 podStartE2EDuration="4.169829836s" totalImagesPullingTime="1.569996612s" totalInitContainerRuntime="97.639138ms" isStatefulPod=true podCreationTimestamp="2026-10-29 23:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:38.159563736 +0000 UTC m=+29.470808063" watchObservedRunningTime="2026-10-29 23:13:38.169829836 +0000 UTC m=+29.481074161"
Oct 29 23:13:38.843418 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:38.843390    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:13:39.202844 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:39.202721    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:39.402403 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:39.402370    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:39.668086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:39.668032    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:39.823369 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:39.823306    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:40.108497 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:40.108457    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sd6x7"
Oct 29 23:13:40.529703 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:40.529673    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:13:41.562406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:41.562369    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:44.141398 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:44.141311    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-j8fs4" event={"ID":"95feb768-13af-4cae-ad0e-6b797cfbe9a0","Type":"ContainerStarted","Data":"cb2c1dbf19dbc2f031f60983154515a423dc601e3937943fc712035bbbe0c32c"}
Oct 29 23:13:44.141870 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:44.141518    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:44.143310 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:44.143284    5044 patch_prober.go:29] interesting pod/downloads-6dd789c8b7-j8fs4 container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.31:8080/\": dial tcp 10.132.0.31:8080: connect: connection refused" start-of-body=
Oct 29 23:13:44.143416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:44.143345    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6dd789c8b7-j8fs4" podUID="95feb768-13af-4cae-ad0e-6b797cfbe9a0" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.31:8080/\": dial tcp 10.132.0.31:8080: connect: connection refused"
Oct 29 23:13:44.195833 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:44.195781    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-j8fs4" podStartSLOduration=1.5539933000000001 podStartE2EDuration="18.195767486s" totalImagesPullingTime="16.641774186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:13:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:13:44.185037264 +0000 UTC m=+35.496281588" watchObservedRunningTime="2026-10-29 23:13:44.195767486 +0000 UTC m=+35.507011811"
Oct 29 23:13:44.625872 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:44.625825    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:45.166564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:45.166536    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-j8fs4"
Oct 29 23:13:46.259071 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:46.259034    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:46.621659 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:46.621581    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:46.784061 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:46.784026    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:47.247876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:47.247843    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:47.450460 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:47.450417    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:49.050934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:49.050703    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-cfcc55999-2vhks"
Oct 29 23:13:49.155044 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:49.155016    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj"]
Oct 29 23:13:49.273892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:49.273853    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:49.411862 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:49.411782    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:49.557497 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:49.555383    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:51.431800 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.431713    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k" podUID="99e1c2a2-3edf-450a-9de0-ec803ff28569" containerName="registry" containerID="cri-o://4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be" gracePeriod=30
Oct 29 23:13:51.746525 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.746472    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:51.840765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.840726    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.840980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.840779    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.840980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.840816    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.840980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.840921    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.841145 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841005    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.841145 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841078    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.841258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841152    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.841258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841221    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:13:51.841355 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841228    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") pod \"99e1c2a2-3edf-450a-9de0-ec803ff28569\" (UID: \"99e1c2a2-3edf-450a-9de0-ec803ff28569\") "
Oct 29 23:13:51.841577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841553    5044 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-certificates\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.842001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.841974    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:13:51.843922 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.843872    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:13:51.847000 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.846948    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:13:51.847637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.847606    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:13:51.848529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.848500    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:13:51.849243 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.849210    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "kube-api-access-5m6gf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:13:51.851750 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.851707    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted" pod "99e1c2a2-3edf-450a-9de0-ec803ff28569" (UID: "99e1c2a2-3edf-450a-9de0-ec803ff28569"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:13:51.942311 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942275    5044 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-installation-pull-secrets\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.942311 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942304    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m6gf\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-kube-api-access-5m6gf\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.942311 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942315    5044 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/99e1c2a2-3edf-450a-9de0-ec803ff28569-image-registry-private-configuration\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.942631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942326    5044 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/99e1c2a2-3edf-450a-9de0-ec803ff28569-ca-trust-extracted\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.942631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942335    5044 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-bound-sa-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.942631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942343    5044 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/99e1c2a2-3edf-450a-9de0-ec803ff28569-registry-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:51.942631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:51.942351    5044 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99e1c2a2-3edf-450a-9de0-ec803ff28569-trusted-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:52.121334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.121296    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:52.189794 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.189759    5044 generic.go:356] "Generic (PLEG): container finished" podID="99e1c2a2-3edf-450a-9de0-ec803ff28569" containerID="4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be" exitCode=0
Oct 29 23:13:52.189959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.189817    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k"
Oct 29 23:13:52.189959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.189820    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k" event={"ID":"99e1c2a2-3edf-450a-9de0-ec803ff28569","Type":"ContainerDied","Data":"4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be"}
Oct 29 23:13:52.189959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.189865    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b87f698cd-z5z9k" event={"ID":"99e1c2a2-3edf-450a-9de0-ec803ff28569","Type":"ContainerDied","Data":"9b4d41b02e671bafb490870ab4ee52f90046a3f85b7f01f60e91ae3a249f262b"}
Oct 29 23:13:52.189959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.189884    5044 scope.go:122] "RemoveContainer" containerID="4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be"
Oct 29 23:13:52.199288 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.199272    5044 scope.go:122] "RemoveContainer" containerID="4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be"
Oct 29 23:13:52.199567 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:52.199547    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be\": container with ID starting with 4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be not found: ID does not exist" containerID="4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be"
Oct 29 23:13:52.199621 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.199576    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be"} err="failed to get container status \"4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be\": rpc error: code = NotFound desc = could not find container \"4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be\": container with ID starting with 4c7b08cd5d8abc614437e41deb77d5fa444b1d8e8cd1354ebf008dbce512f9be not found: ID does not exist"
Oct 29 23:13:52.233329 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.233300    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b87f698cd-z5z9k"]
Oct 29 23:13:52.242842 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.242819    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b87f698cd-z5z9k"]
Oct 29 23:13:52.267728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.267704    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:52.819172 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:52.819143    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="99e1c2a2-3edf-450a-9de0-ec803ff28569" path="/var/lib/kubelet/pods/99e1c2a2-3edf-450a-9de0-ec803ff28569/volumes"
Oct 29 23:13:53.425587 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:53.425557    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:53.573454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:53.573413    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:53.993231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:53.993195    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:54.140405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:54.140374    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:55.237166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:55.237134    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:55.376739 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:55.376704    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:56.065511 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:56.065455    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:56.257203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:56.257167    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:57.102422 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:57.102384    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:57.311160 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:57.311121    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:57.935764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:57.935726    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:58.119420 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:58.119384    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:13:58.810943 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:58.810904    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-79nrp-sxknn"]
Oct 29 23:13:58.811430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:58.811173    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-79nrp-sxknn" podUID="572f6f60-a6cb-4498-ada7-94531d16c807" containerName="insights-gathering" containerID="cri-o://81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9" gracePeriod=30
Oct 29 23:13:59.124490 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.124460    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:59.209180 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209141    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") pod \"572f6f60-a6cb-4498-ada7-94531d16c807\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") "
Oct 29 23:13:59.209358 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209233    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") pod \"572f6f60-a6cb-4498-ada7-94531d16c807\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") "
Oct 29 23:13:59.209358 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209276    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") pod \"572f6f60-a6cb-4498-ada7-94531d16c807\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") "
Oct 29 23:13:59.209358 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209321    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") pod \"572f6f60-a6cb-4498-ada7-94531d16c807\" (UID: \"572f6f60-a6cb-4498-ada7-94531d16c807\") "
Oct 29 23:13:59.209551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209524    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path" pod "572f6f60-a6cb-4498-ada7-94531d16c807" (UID: "572f6f60-a6cb-4498-ada7-94531d16c807"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:13:59.209743 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209722    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle" pod "572f6f60-a6cb-4498-ada7-94531d16c807" (UID: "572f6f60-a6cb-4498-ada7-94531d16c807"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:13:59.209782 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.209742    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle" pod "572f6f60-a6cb-4498-ada7-94531d16c807" (UID: "572f6f60-a6cb-4498-ada7-94531d16c807"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:13:59.211595 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.211575    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk" pod "572f6f60-a6cb-4498-ada7-94531d16c807" (UID: "572f6f60-a6cb-4498-ada7-94531d16c807"). InnerVolumeSpecName "kube-api-access-wb4gk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:13:59.220924 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.220899    5044 generic.go:356] "Generic (PLEG): container finished" podID="572f6f60-a6cb-4498-ada7-94531d16c807" containerID="81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9" exitCode=2
Oct 29 23:13:59.221053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.220940    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-79nrp-sxknn"
Oct 29 23:13:59.221053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.220950    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-79nrp-sxknn" event={"ID":"572f6f60-a6cb-4498-ada7-94531d16c807","Type":"ContainerDied","Data":"81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9"}
Oct 29 23:13:59.221053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.220989    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-79nrp-sxknn" event={"ID":"572f6f60-a6cb-4498-ada7-94531d16c807","Type":"ContainerDied","Data":"0ee299238cec022cefa3bbd5fabd529cc1863da603d0569a5a0c74c112e5fbae"}
Oct 29 23:13:59.221053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.221016    5044 scope.go:122] "RemoveContainer" containerID="81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9"
Oct 29 23:13:59.231562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.231410    5044 scope.go:122] "RemoveContainer" containerID="81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9"
Oct 29 23:13:59.231893 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:13:59.231810    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9\": container with ID starting with 81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9 not found: ID does not exist" containerID="81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9"
Oct 29 23:13:59.231893 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.231851    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9"} err="failed to get container status \"81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9\": rpc error: code = NotFound desc = could not find container \"81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9\": container with ID starting with 81a2d273d65f48419464c4689245541e388b721e3608a038f9f445cc935234e9 not found: ID does not exist"
Oct 29 23:13:59.270092 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.270063    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-79nrp-sxknn"]
Oct 29 23:13:59.271212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.271188    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-79nrp-sxknn"]
Oct 29 23:13:59.310205 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.310179    5044 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/572f6f60-a6cb-4498-ada7-94531d16c807-archives-path\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:59.310205 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.310204    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb4gk\" (UniqueName: \"kubernetes.io/projected/572f6f60-a6cb-4498-ada7-94531d16c807-kube-api-access-wb4gk\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:59.310386 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.310214    5044 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-trusted-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:13:59.310386 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:13:59.310223    5044 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/572f6f60-a6cb-4498-ada7-94531d16c807-service-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:00.819033 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:00.818998    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="572f6f60-a6cb-4498-ada7-94531d16c807" path="/var/lib/kubelet/pods/572f6f60-a6cb-4498-ada7-94531d16c807/volumes"
Oct 29 23:14:01.372889 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:01.372840    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:01.521008 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:01.520952    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:07.125159 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:07.125122    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:07.269170 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:07.269137    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:10.525936 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:14:10.525894    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:14:14.067225 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.067190    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:14.184229 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.184177    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerName="registry" containerID="cri-o://51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466" gracePeriod=30
Oct 29 23:14:14.212293 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.212252    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:14.481870 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.481840    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:14:14.647637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647563    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647605    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647645    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647671    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647749    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647794    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647983 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647837    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.647983 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.647876    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") pod \"f68b6b5d-44aa-4e94-b320-a669b4f09250\" (UID: \"f68b6b5d-44aa-4e94-b320-a669b4f09250\") "
Oct 29 23:14:14.648462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.648289    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:14:14.648658 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.648561    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:14:14.650514 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.650471    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:14:14.650650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.650627    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:14:14.650711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.650661    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:14:14.650812 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.650793    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "kube-api-access-kkpw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:14:14.650812 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.650801    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:14:14.655167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.655145    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted" pod "f68b6b5d-44aa-4e94-b320-a669b4f09250" (UID: "f68b6b5d-44aa-4e94-b320-a669b4f09250"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:14:14.722869 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.722836    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:14.748937 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748912    5044 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-bound-sa-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.748937 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748936    5044 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-installation-pull-secrets\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.749113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748946    5044 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-trusted-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.749113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748957    5044 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f68b6b5d-44aa-4e94-b320-a669b4f09250-image-registry-private-configuration\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.749113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748966    5044 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-certificates\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.749113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748975    5044 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-registry-tls\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.749113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748983    5044 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f68b6b5d-44aa-4e94-b320-a669b4f09250-ca-trust-extracted\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.749113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.748991    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkpw5\" (UniqueName: \"kubernetes.io/projected/f68b6b5d-44aa-4e94-b320-a669b4f09250-kube-api-access-kkpw5\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:14.881256 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:14.881216    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:15.295990 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.295955    5044 generic.go:356] "Generic (PLEG): container finished" podID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerID="51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466" exitCode=0
Oct 29 23:14:15.296395 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.296000    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj"
Oct 29 23:14:15.296395 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.296032    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" event={"ID":"f68b6b5d-44aa-4e94-b320-a669b4f09250","Type":"ContainerDied","Data":"51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466"}
Oct 29 23:14:15.296395 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.296078    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-799bd4bb47-g7rsj" event={"ID":"f68b6b5d-44aa-4e94-b320-a669b4f09250","Type":"ContainerDied","Data":"2b7c97ae8faa1b499711d92791e156b710ba07ae9e8d8cda9e24ce7b14575f7b"}
Oct 29 23:14:15.296395 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.296098    5044 scope.go:122] "RemoveContainer" containerID="51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466"
Oct 29 23:14:15.304459 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.304442    5044 scope.go:122] "RemoveContainer" containerID="51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466"
Oct 29 23:14:15.304737 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:14:15.304719    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466\": container with ID starting with 51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466 not found: ID does not exist" containerID="51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466"
Oct 29 23:14:15.304813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.304743    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466"} err="failed to get container status \"51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466\": rpc error: code = NotFound desc = could not find container \"51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466\": container with ID starting with 51365be6943649d0c8ee02be99e4b9819ac85e54493f8fd558889acddb211466 not found: ID does not exist"
Oct 29 23:14:15.351137 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.351110    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj"]
Oct 29 23:14:15.360796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:15.360774    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-799bd4bb47-g7rsj"]
Oct 29 23:14:16.818941 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:16.818906    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" path="/var/lib/kubelet/pods/f68b6b5d-44aa-4e94-b320-a669b4f09250/volumes"
Oct 29 23:14:24.691454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:24.691419    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:24.838736 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:24.838698    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:38.395580 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:38.395540    5044 generic.go:356] "Generic (PLEG): container finished" podID="791d6e15-ebf3-4d7a-b4d2-c5d11b17c173" containerID="0e5f974c2465d423a2e8e9a382ad912f5c9206c159604ca140b4d7e93e4a72e8" exitCode=0
Oct 29 23:14:38.396008 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:38.395602    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z" event={"ID":"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173","Type":"ContainerDied","Data":"0e5f974c2465d423a2e8e9a382ad912f5c9206c159604ca140b4d7e93e4a72e8"}
Oct 29 23:14:38.396008 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:38.395897    5044 scope.go:122] "RemoveContainer" containerID="0e5f974c2465d423a2e8e9a382ad912f5c9206c159604ca140b4d7e93e4a72e8"
Oct 29 23:14:39.401434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:39.401397    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-4rs7z" event={"ID":"791d6e15-ebf3-4d7a-b4d2-c5d11b17c173","Type":"ContainerStarted","Data":"7b73b662db05ec0a8c944fd77ac647c59ca1c5c75c62e1d2507298ff11a856a6"}
Oct 29 23:14:40.000107 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:40.000053    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:40.138523 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:40.138460    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:40.526050 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:14:40.526011    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:14:43.505689 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:43.505655    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:45.430561 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:45.430506    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:45.725983 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:45.725948    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:45.876903 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:45.876864    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:52.455899 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:52.455866    5044 generic.go:356] "Generic (PLEG): container finished" podID="42a578bd-8156-4601-8d0f-eba1dcffa139" containerID="221cc4e233a94dbb9e54eefd7b8b5a11bc60f4f29ce2083e5f99ac24d04626dc" exitCode=0
Oct 29 23:14:52.456262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:52.455941    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns" event={"ID":"42a578bd-8156-4601-8d0f-eba1dcffa139","Type":"ContainerDied","Data":"221cc4e233a94dbb9e54eefd7b8b5a11bc60f4f29ce2083e5f99ac24d04626dc"}
Oct 29 23:14:53.596334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.596311    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:14:53.666979 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.666949    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx\" (UniqueName: \"kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx\") pod \"42a578bd-8156-4601-8d0f-eba1dcffa139\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") "
Oct 29 23:14:53.666979 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.666981    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle\") pod \"42a578bd-8156-4601-8d0f-eba1dcffa139\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") "
Oct 29 23:14:53.667190 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.667038    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle\") pod \"42a578bd-8156-4601-8d0f-eba1dcffa139\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") "
Oct 29 23:14:53.667190 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.667099    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path\") pod \"42a578bd-8156-4601-8d0f-eba1dcffa139\" (UID: \"42a578bd-8156-4601-8d0f-eba1dcffa139\") "
Oct 29 23:14:53.667431 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.667407    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path" pod "42a578bd-8156-4601-8d0f-eba1dcffa139" (UID: "42a578bd-8156-4601-8d0f-eba1dcffa139"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:14:53.667431 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.667412    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle" pod "42a578bd-8156-4601-8d0f-eba1dcffa139" (UID: "42a578bd-8156-4601-8d0f-eba1dcffa139"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:14:53.667562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.667418    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle" pod "42a578bd-8156-4601-8d0f-eba1dcffa139" (UID: "42a578bd-8156-4601-8d0f-eba1dcffa139"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:14:53.669003 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.668980    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx" pod "42a578bd-8156-4601-8d0f-eba1dcffa139" (UID: "42a578bd-8156-4601-8d0f-eba1dcffa139"). InnerVolumeSpecName "kube-api-access-hw5qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:14:53.768528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.768501    5044 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-trusted-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:53.768528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.768529    5044 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/42a578bd-8156-4601-8d0f-eba1dcffa139-archives-path\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:53.768726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.768539    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw5qx\" (UniqueName: \"kubernetes.io/projected/42a578bd-8156-4601-8d0f-eba1dcffa139-kube-api-access-hw5qx\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:53.768726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:53.768551    5044 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a578bd-8156-4601-8d0f-eba1dcffa139-service-ca-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:14:54.465805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:54.465774    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns"
Oct 29 23:14:54.465805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:54.465793    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-w2d6w-lw5ns" event={"ID":"42a578bd-8156-4601-8d0f-eba1dcffa139","Type":"ContainerDied","Data":"656ff9899f2b26e0e0cf22d05a3729dba3f709bb096001119deb59c6fadb679d"}
Oct 29 23:14:54.466024 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:54.465835    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="656ff9899f2b26e0e0cf22d05a3729dba3f709bb096001119deb59c6fadb679d"
Oct 29 23:14:55.057770 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:55.057733    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:55.216033 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:55.215995    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:55.361587 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:55.361500    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:55.572504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:55.572444    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:14:58.047183 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:14:58.047147    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:07.148549 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:07.148510    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:07.336226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:07.336188    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:10.525737 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:15:10.525696    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:15:13.757827 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:13.757791    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:13.910386 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:13.910356    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:15.088617 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:15.088584    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:40.525608 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:15:40.525571    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:15:53.203596 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:53.203560    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:15:58.167527 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:15:58.167487    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:16:10.525440 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:16:10.525402    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:16:14.331534 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:16:14.331495    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:16:24.770140 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:16:24.770092    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:16:26.003106 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:16:26.003058    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:16:40.525632 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:16:40.525597    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:16:47.772761 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:16:47.772719    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:16:47.922558 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:16:47.922526    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:16:58.289895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:16:58.289810    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:01.867092 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:01.867053    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:02.076586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:02.076540    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:03.389004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:03.388967    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:03.558238 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:03.558203    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:04.736551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:04.736516    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:07.682909 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:07.682875    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:07.862908 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:07.862865    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:08.558032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.557994    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:08.575802 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.575773    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"]
Oct 29 23:17:08.576235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576213    5044 cpu_manager.go:414] "containerMap: removing container" podUID="42a578bd-8156-4601-8d0f-eba1dcffa139" containerName="insights-gathering"
Oct 29 23:17:08.576297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576240    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="42a578bd-8156-4601-8d0f-eba1dcffa139" containerName="insights-gathering"
Oct 29 23:17:08.576297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576260    5044 cpu_manager.go:414] "containerMap: removing container" podUID="99e1c2a2-3edf-450a-9de0-ec803ff28569" containerName="registry"
Oct 29 23:17:08.576297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576268    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99e1c2a2-3edf-450a-9de0-ec803ff28569" containerName="registry"
Oct 29 23:17:08.576297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576278    5044 cpu_manager.go:414] "containerMap: removing container" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerName="registry"
Oct 29 23:17:08.576297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576285    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerName="registry"
Oct 29 23:17:08.576297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576295    5044 cpu_manager.go:414] "containerMap: removing container" podUID="572f6f60-a6cb-4498-ada7-94531d16c807" containerName="insights-gathering"
Oct 29 23:17:08.576593 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576303    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="572f6f60-a6cb-4498-ada7-94531d16c807" containerName="insights-gathering"
Oct 29 23:17:08.576593 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576407    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="42a578bd-8156-4601-8d0f-eba1dcffa139" containerName="insights-gathering"
Oct 29 23:17:08.576593 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576422    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="99e1c2a2-3edf-450a-9de0-ec803ff28569" containerName="registry"
Oct 29 23:17:08.576593 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576429    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="f68b6b5d-44aa-4e94-b320-a669b4f09250" containerName="registry"
Oct 29 23:17:08.576593 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.576438    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="572f6f60-a6cb-4498-ada7-94531d16c807" containerName="insights-gathering"
Oct 29 23:17:08.579851 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.579829    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.592685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.592667    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 29 23:17:08.606237 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.606214    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"]
Oct 29 23:17:08.608379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.608355    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-b6r4l\""
Oct 29 23:17:08.728015 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.727980    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a42b06-14b1-41fc-b997-1f82414ad628-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728027    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728050    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmkpb\" (UniqueName: \"kubernetes.io/projected/49a42b06-14b1-41fc-b997-1f82414ad628-kube-api-access-lmkpb\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728154    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728183    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728211    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728266    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a42b06-14b1-41fc-b997-1f82414ad628-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728301    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.728385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.728377    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a42b06-14b1-41fc-b997-1f82414ad628-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.734387 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.734357    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:08.829767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829692    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a42b06-14b1-41fc-b997-1f82414ad628-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.829767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829735    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.829767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829753    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmkpb\" (UniqueName: \"kubernetes.io/projected/49a42b06-14b1-41fc-b997-1f82414ad628-kube-api-access-lmkpb\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829779    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829796    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829828    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829855    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a42b06-14b1-41fc-b997-1f82414ad628-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829885    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.829989    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a42b06-14b1-41fc-b997-1f82414ad628-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830380 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.830142    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830380 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.830270    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.830468    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.830590 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.830569    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.832074 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.832045    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49a42b06-14b1-41fc-b997-1f82414ad628-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.832208 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.832118    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49a42b06-14b1-41fc-b997-1f82414ad628-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.840932 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.840911    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 29 23:17:08.845954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.845926    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49a42b06-14b1-41fc-b997-1f82414ad628-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.846331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.846313    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmkpb\" (UniqueName: \"kubernetes.io/projected/49a42b06-14b1-41fc-b997-1f82414ad628-kube-api-access-lmkpb\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.850645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.850627    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49a42b06-14b1-41fc-b997-1f82414ad628-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc\" (UID: \"49a42b06-14b1-41fc-b997-1f82414ad628\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:08.904822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.904795    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-b6r4l\""
Oct 29 23:17:08.914059 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:08.914032    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:09.219228 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:09.219203    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"]
Oct 29 23:17:09.221077 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:17:09.221048    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a42b06_14b1_41fc_b997_1f82414ad628.slice/crio-ee68a92c373fdf47ecd38bf2b1d5293d66c0802d89929d0bd0a7832e5549d2c7 WatchSource:0}: Error finding container ee68a92c373fdf47ecd38bf2b1d5293d66c0802d89929d0bd0a7832e5549d2c7: Status 404 returned error can't find the container with id ee68a92c373fdf47ecd38bf2b1d5293d66c0802d89929d0bd0a7832e5549d2c7
Oct 29 23:17:10.001632 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:10.001590    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc" event={"ID":"49a42b06-14b1-41fc-b997-1f82414ad628","Type":"ContainerStarted","Data":"ee68a92c373fdf47ecd38bf2b1d5293d66c0802d89929d0bd0a7832e5549d2c7"}
Oct 29 23:17:10.533727 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:17:10.533686    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:17:11.691281 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.691252    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:17:11.691562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.691318    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:17:11.691562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.691350    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:17:11.829376 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.829347    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"]
Oct 29 23:17:11.833361 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.833341    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:11.845888 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.845868    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 29 23:17:11.855407 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.855384    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 29 23:17:11.855543 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.855464    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-pqx8f\""
Oct 29 23:17:11.861646 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.861625    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"]
Oct 29 23:17:11.877741 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.877714    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"]
Oct 29 23:17:11.882063 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.882040    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:11.906875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.906841    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"]
Oct 29 23:17:11.947161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.947070    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-wtg5m\""
Oct 29 23:17:11.957551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.957524    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlqnj\" (UniqueName: \"kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:11.957642 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.957565    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:11.957642 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.957594    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x4s6\" (UniqueName: \"kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:11.957757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.957734    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:11.957793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.957774    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:11.957853 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:11.957842    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.013207 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.013174    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc" event={"ID":"49a42b06-14b1-41fc-b997-1f82414ad628","Type":"ContainerStarted","Data":"1230e21621e4064a1088351a4e87162352cbafe660e9cf3e6cab43e18337e611"}
Oct 29 23:17:12.054289 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.054233    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc" podStartSLOduration=1.586676453 podStartE2EDuration="4.054215078s" totalImagesPullingTime="2.467538625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:12.05281637 +0000 UTC m=+243.364060701" watchObservedRunningTime="2026-10-29 23:17:12.054215078 +0000 UTC m=+243.365459400"
Oct 29 23:17:12.059204 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059179    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.059326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059215    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4s6\" (UniqueName: \"kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.059326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059261    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.059326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059279    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.059326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059306    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.059556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059329    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlqnj\" (UniqueName: \"kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.059690 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059663    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.059751 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059692    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.059751 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059725    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.059751 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.059725    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.080161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.080129    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x4s6\" (UniqueName: \"kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.081415 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.081392    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlqnj\" (UniqueName: \"kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.105748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.105711    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:12.149425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.149398    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:12.201784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.200566    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:12.455950 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.455925    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"]
Oct 29 23:17:12.458182 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:17:12.458153    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0781ba3_c801_44c9_9f4d_d81371a5c9a3.slice/crio-60c11c5044d890c9fca99b6975900d05ecc25336a145661268aab10e4e1e3c99 WatchSource:0}: Error finding container 60c11c5044d890c9fca99b6975900d05ecc25336a145661268aab10e4e1e3c99: Status 404 returned error can't find the container with id 60c11c5044d890c9fca99b6975900d05ecc25336a145661268aab10e4e1e3c99
Oct 29 23:17:12.503663 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.503623    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"]
Oct 29 23:17:12.506902 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:17:12.506874    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf29aa22f_6b8b_407f_ac2a_aa488e3ae71a.slice/crio-c9e81935751b28e159587ac0ae2bdcc0254292edddaecffc04e80d05652ae0ef WatchSource:0}: Error finding container c9e81935751b28e159587ac0ae2bdcc0254292edddaecffc04e80d05652ae0ef: Status 404 returned error can't find the container with id c9e81935751b28e159587ac0ae2bdcc0254292edddaecffc04e80d05652ae0ef
Oct 29 23:17:12.914406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.914359    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:12.920420 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:12.920394    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:13.020707 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:13.020163    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v" event={"ID":"c0781ba3-c801-44c9-9f4d-d81371a5c9a3","Type":"ContainerStarted","Data":"60c11c5044d890c9fca99b6975900d05ecc25336a145661268aab10e4e1e3c99"}
Oct 29 23:17:13.021562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:13.021522    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk" event={"ID":"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a","Type":"ContainerStarted","Data":"c9e81935751b28e159587ac0ae2bdcc0254292edddaecffc04e80d05652ae0ef"}
Oct 29 23:17:13.021887 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:13.021858    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:13.023092 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:13.023070    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc"
Oct 29 23:17:18.292975 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:18.292918    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:19.052783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:19.052746    5044 generic.go:356] "Generic (PLEG): container finished" podID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerID="3b2a1b0041eeb74deedad7e716dc1655cb8a6158da7f1155e0c5fb905e623f69" exitCode=0
Oct 29 23:17:19.052982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:19.052826    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v" event={"ID":"c0781ba3-c801-44c9-9f4d-d81371a5c9a3","Type":"ContainerDied","Data":"3b2a1b0041eeb74deedad7e716dc1655cb8a6158da7f1155e0c5fb905e623f69"}
Oct 29 23:17:19.054311 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:19.054284    5044 generic.go:356] "Generic (PLEG): container finished" podID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerID="8f3cf1652c25bd56427884d296dd89c81e438e5b2e4b398c4b9a30e946e606f3" exitCode=0
Oct 29 23:17:19.054410 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:19.054375    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk" event={"ID":"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a","Type":"ContainerDied","Data":"8f3cf1652c25bd56427884d296dd89c81e438e5b2e4b398c4b9a30e946e606f3"}
Oct 29 23:17:20.061756 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:20.061725    5044 generic.go:356] "Generic (PLEG): container finished" podID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerID="abc4d72f9174c42b8ceb432ef84ea679297c951b744c195bbc6bb74977211993" exitCode=0
Oct 29 23:17:20.062135 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:20.061798    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v" event={"ID":"c0781ba3-c801-44c9-9f4d-d81371a5c9a3","Type":"ContainerDied","Data":"abc4d72f9174c42b8ceb432ef84ea679297c951b744c195bbc6bb74977211993"}
Oct 29 23:17:20.063794 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:20.063772    5044 generic.go:356] "Generic (PLEG): container finished" podID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerID="0319d2dbf4bafbef55dc2d9b6c13dba1c0584f817da054bd2556f11aecf948df" exitCode=0
Oct 29 23:17:20.063882 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:20.063848    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk" event={"ID":"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a","Type":"ContainerDied","Data":"0319d2dbf4bafbef55dc2d9b6c13dba1c0584f817da054bd2556f11aecf948df"}
Oct 29 23:17:27.102081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:27.101983    5044 generic.go:356] "Generic (PLEG): container finished" podID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerID="4b1a3360e9a7f7aa03b4edccba86f978b52146f060b1b84e3d2657a2888ec861" exitCode=0
Oct 29 23:17:27.102081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:27.102017    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v" event={"ID":"c0781ba3-c801-44c9-9f4d-d81371a5c9a3","Type":"ContainerDied","Data":"4b1a3360e9a7f7aa03b4edccba86f978b52146f060b1b84e3d2657a2888ec861"}
Oct 29 23:17:27.104161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:27.104139    5044 generic.go:356] "Generic (PLEG): container finished" podID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerID="1f8f8fe50badb44bba34b7146085d1521321bfdf3306a5e97c67a7bf97e3e5a9" exitCode=0
Oct 29 23:17:27.104297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:27.104220    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk" event={"ID":"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a","Type":"ContainerDied","Data":"1f8f8fe50badb44bba34b7146085d1521321bfdf3306a5e97c67a7bf97e3e5a9"}
Oct 29 23:17:28.002233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.002181    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:28.269155 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.269133    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:28.271891 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.271871    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:28.410966 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.410938    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle\") pod \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") "
Oct 29 23:17:28.411131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.410992    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util\") pod \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") "
Oct 29 23:17:28.411131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.411022    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj\" (UniqueName: \"kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj\") pod \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") "
Oct 29 23:17:28.411131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.411043    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6\" (UniqueName: \"kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6\") pod \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") "
Oct 29 23:17:28.411131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.411062    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle\") pod \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\" (UID: \"c0781ba3-c801-44c9-9f4d-d81371a5c9a3\") "
Oct 29 23:17:28.411131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.411092    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util\") pod \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\" (UID: \"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a\") "
Oct 29 23:17:28.411724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.411684    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle" pod "c0781ba3-c801-44c9-9f4d-d81371a5c9a3" (UID: "c0781ba3-c801-44c9-9f4d-d81371a5c9a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:17:28.411860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.411700    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle" pod "f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" (UID: "f29aa22f-6b8b-407f-ac2a-aa488e3ae71a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:17:28.413345 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.413310    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj" pod "f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" (UID: "f29aa22f-6b8b-407f-ac2a-aa488e3ae71a"). InnerVolumeSpecName "kube-api-access-rlqnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:17:28.413521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.413503    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6" pod "c0781ba3-c801-44c9-9f4d-d81371a5c9a3" (UID: "c0781ba3-c801-44c9-9f4d-d81371a5c9a3"). InnerVolumeSpecName "kube-api-access-6x4s6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:17:28.415929 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.415906    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util" pod "f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" (UID: "f29aa22f-6b8b-407f-ac2a-aa488e3ae71a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:17:28.416768 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.416746    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util" pod "c0781ba3-c801-44c9-9f4d-d81371a5c9a3" (UID: "c0781ba3-c801-44c9-9f4d-d81371a5c9a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:17:28.512559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.512469    5044 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:17:28.512559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.512517    5044 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-util\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:17:28.512559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.512530    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlqnj\" (UniqueName: \"kubernetes.io/projected/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-kube-api-access-rlqnj\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:17:28.512559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.512543    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x4s6\" (UniqueName: \"kubernetes.io/projected/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-kube-api-access-6x4s6\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:17:28.512559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.512555    5044 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0781ba3-c801-44c9-9f4d-d81371a5c9a3-bundle\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:17:28.512786 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:28.512568    5044 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f29aa22f-6b8b-407f-ac2a-aa488e3ae71a-util\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:17:29.115898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:29.115823    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v"
Oct 29 23:17:29.115898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:29.115835    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7dzl4v" event={"ID":"c0781ba3-c801-44c9-9f4d-d81371a5c9a3","Type":"ContainerDied","Data":"60c11c5044d890c9fca99b6975900d05ecc25336a145661268aab10e4e1e3c99"}
Oct 29 23:17:29.116223 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:29.115900    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60c11c5044d890c9fca99b6975900d05ecc25336a145661268aab10e4e1e3c99"
Oct 29 23:17:29.117865 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:29.117835    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk" event={"ID":"f29aa22f-6b8b-407f-ac2a-aa488e3ae71a","Type":"ContainerDied","Data":"c9e81935751b28e159587ac0ae2bdcc0254292edddaecffc04e80d05652ae0ef"}
Oct 29 23:17:29.118001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:29.117882    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847adqftk"
Oct 29 23:17:29.118164 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:29.117882    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9e81935751b28e159587ac0ae2bdcc0254292edddaecffc04e80d05652ae0ef"
Oct 29 23:17:40.525299 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:17:40.525262    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:17:49.389821 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:49.389778    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:49.602039 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:49.602002    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:50.059538 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.059504    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:50.191897 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.191848    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"]
Oct 29 23:17:50.192277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192258    5044 cpu_manager.go:414] "containerMap: removing container" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="pull"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192279    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="pull"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192305    5044 cpu_manager.go:414] "containerMap: removing container" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="util"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192313    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="util"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192326    5044 cpu_manager.go:414] "containerMap: removing container" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="extract"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192333    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="extract"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192346    5044 cpu_manager.go:414] "containerMap: removing container" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="extract"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192353    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="extract"
Oct 29 23:17:50.192365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192364    5044 cpu_manager.go:414] "containerMap: removing container" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="pull"
Oct 29 23:17:50.192767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192371    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="pull"
Oct 29 23:17:50.192767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192383    5044 cpu_manager.go:414] "containerMap: removing container" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="util"
Oct 29 23:17:50.192767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192390    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="util"
Oct 29 23:17:50.192767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192547    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="f29aa22f-6b8b-407f-ac2a-aa488e3ae71a" containerName="extract"
Oct 29 23:17:50.192767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.192560    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="c0781ba3-c801-44c9-9f4d-d81371a5c9a3" containerName="extract"
Oct 29 23:17:50.195736 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.195716    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.211515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.211473    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 29 23:17:50.212440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.212426    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 29 23:17:50.235549 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.235509    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"]
Oct 29 23:17:50.281631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.281603    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.281754 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.281634    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtr5\" (UniqueName: \"kubernetes.io/projected/bd7459bb-db42-425e-8a89-16d3dfcd93d2-kube-api-access-tjtr5\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.281754 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.281655    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd7459bb-db42-425e-8a89-16d3dfcd93d2-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.281754 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.281684    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd7459bb-db42-425e-8a89-16d3dfcd93d2-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.281857 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.281783    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.281857 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.281821    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.316021 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.315949    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 29 23:17:50.316147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.316086    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 29 23:17:50.316147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.316116    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-5l76q\""
Oct 29 23:17:50.316147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.316128    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 29 23:17:50.382374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.382349    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.382542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.382385    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.382542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.382435    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.382542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.382452    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtr5\" (UniqueName: \"kubernetes.io/projected/bd7459bb-db42-425e-8a89-16d3dfcd93d2-kube-api-access-tjtr5\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.382542 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.382472    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd7459bb-db42-425e-8a89-16d3dfcd93d2-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.382740 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.382633    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd7459bb-db42-425e-8a89-16d3dfcd93d2-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.383031 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.383003    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bd7459bb-db42-425e-8a89-16d3dfcd93d2-manifests\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.384799 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.384772    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd7459bb-db42-425e-8a89-16d3dfcd93d2-tmp\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.384896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.384778    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.384951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.384931    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-metrics-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.384993 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.384935    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bd7459bb-db42-425e-8a89-16d3dfcd93d2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.399396 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.399372    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtr5\" (UniqueName: \"kubernetes.io/projected/bd7459bb-db42-425e-8a89-16d3dfcd93d2-kube-api-access-tjtr5\") pod \"opendatahub-operator-controller-manager-5588597fcf-p785t\" (UID: \"bd7459bb-db42-425e-8a89-16d3dfcd93d2\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.413429 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.413409    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:50.510829 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.510792    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:50.573960 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.573875    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:50.737113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.737077    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:50.857382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:50.857358    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"]
Oct 29 23:17:50.860330 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:17:50.860301    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd7459bb_db42_425e_8a89_16d3dfcd93d2.slice/crio-886449817e020ac1ad2fefea83639e08013e621d6a03752b78f7d42f87bc046e WatchSource:0}: Error finding container 886449817e020ac1ad2fefea83639e08013e621d6a03752b78f7d42f87bc046e: Status 404 returned error can't find the container with id 886449817e020ac1ad2fefea83639e08013e621d6a03752b78f7d42f87bc046e
Oct 29 23:17:51.219673 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:51.219585    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t" event={"ID":"bd7459bb-db42-425e-8a89-16d3dfcd93d2","Type":"ContainerStarted","Data":"886449817e020ac1ad2fefea83639e08013e621d6a03752b78f7d42f87bc046e"}
Oct 29 23:17:51.221065 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:51.221034    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:51.390408 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:51.390333    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:53.404300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:53.404259    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:53.609159 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:53.609124    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:54.241689 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:54.241653    5044 generic.go:356] "Generic (PLEG): container finished" podID="bd7459bb-db42-425e-8a89-16d3dfcd93d2" containerID="5cc1eaf325f1a3fc76e17fe36bcafaf996c9b945148110ea62ce39653810a64a" exitCode=0
Oct 29 23:17:54.241852 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:54.241692    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t" event={"ID":"bd7459bb-db42-425e-8a89-16d3dfcd93d2","Type":"ContainerDied","Data":"5cc1eaf325f1a3fc76e17fe36bcafaf996c9b945148110ea62ce39653810a64a"}
Oct 29 23:17:54.585081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:54.585051    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:55.248468 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:55.248434    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t" event={"ID":"bd7459bb-db42-425e-8a89-16d3dfcd93d2","Type":"ContainerStarted","Data":"3ef98515a1d36d1a34ced69e3e3910fd3d0d9619ac6a2173661e60dfe97c01d6"}
Oct 29 23:17:55.248652 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:55.248536    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:17:55.326703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:55.326649    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t" podStartSLOduration=1.79623941 podStartE2EDuration="5.326634757s" totalImagesPullingTime="2.99444683s" totalInitContainerRuntime="535.948517ms" isStatefulPod=false podCreationTimestamp="2026-10-29 23:17:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:17:55.316715838 +0000 UTC m=+286.627960162" watchObservedRunningTime="2026-10-29 23:17:55.326634757 +0000 UTC m=+286.637879082"
Oct 29 23:17:55.874494 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:55.874445    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:56.047338 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:56.047297    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:58.178017 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:58.177975    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:17:58.393082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:17:58.393050    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:03.400268 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:03.400227    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:03.558969 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:03.558932    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:03.719072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:03.718978    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:04.257799 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:04.257763    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:04.413350 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:04.413314    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:05.764492 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:05.764453    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:06.255980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:06.255953    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-5588597fcf-p785t"
Oct 29 23:18:07.220024 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:07.219985    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:07.390409 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:07.390364    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:08.056662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:08.056622    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:08.610241 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:08.610201    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:08.829567 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:08.829533    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:08.840787 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:08.840766    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:18:08.842013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:08.841990    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:18:09.995971 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:09.995939    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:10.240910 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.240877    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:10.526312 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:18:10.526270    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:18:10.658293 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.658258    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"]
Oct 29 23:18:10.664852 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.664826    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.689143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.689115    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 29 23:18:10.689285 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.689164    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 29 23:18:10.689285 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.689195    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 29 23:18:10.690881 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.690866    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 29 23:18:10.690957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.690892    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hvkkc\""
Oct 29 23:18:10.700578 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.700553    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"]
Oct 29 23:18:10.755294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.755266    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7btm4\" (UniqueName: \"kubernetes.io/projected/761f5568-5049-4c79-b02c-9fd14fbe5009-kube-api-access-7btm4\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.755416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.755306    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/761f5568-5049-4c79-b02c-9fd14fbe5009-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.755512 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.755438    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/761f5568-5049-4c79-b02c-9fd14fbe5009-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.767771 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.767743    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:10.856226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.856163    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/761f5568-5049-4c79-b02c-9fd14fbe5009-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.856226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.856223    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7btm4\" (UniqueName: \"kubernetes.io/projected/761f5568-5049-4c79-b02c-9fd14fbe5009-kube-api-access-7btm4\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.856369 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.856247    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/761f5568-5049-4c79-b02c-9fd14fbe5009-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.856892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.856875    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/761f5568-5049-4c79-b02c-9fd14fbe5009-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.858605 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.858588    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/761f5568-5049-4c79-b02c-9fd14fbe5009-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.875014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.874989    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7btm4\" (UniqueName: \"kubernetes.io/projected/761f5568-5049-4c79-b02c-9fd14fbe5009-kube-api-access-7btm4\") pod \"kuadrant-console-plugin-66c4fb575d-j9gfc\" (UID: \"761f5568-5049-4c79-b02c-9fd14fbe5009\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:10.987248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:10.987222    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"
Oct 29 23:18:11.032389 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.032293    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:11.296720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.296646    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc"]
Oct 29 23:18:11.298874 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:18:11.298845    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod761f5568_5049_4c79_b02c_9fd14fbe5009.slice/crio-c1646e034e983509f57402302a25793488b61cc594e8bc6bbf57901b5094a191 WatchSource:0}: Error finding container c1646e034e983509f57402302a25793488b61cc594e8bc6bbf57901b5094a191: Status 404 returned error can't find the container with id c1646e034e983509f57402302a25793488b61cc594e8bc6bbf57901b5094a191
Oct 29 23:18:11.300218 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.300203    5044 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 29 23:18:11.319250 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.319222    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc" event={"ID":"761f5568-5049-4c79-b02c-9fd14fbe5009","Type":"ContainerStarted","Data":"c1646e034e983509f57402302a25793488b61cc594e8bc6bbf57901b5094a191"}
Oct 29 23:18:11.470515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.470467    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"]
Oct 29 23:18:11.475389 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.475362    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:11.491462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.491438    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t5gzk\""
Oct 29 23:18:11.501314 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.501290    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"]
Oct 29 23:18:11.562393 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.562323    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt4rp\" (UniqueName: \"kubernetes.io/projected/3138ed5e-517d-41c5-8db4-e66c8e8ad523-kube-api-access-tt4rp\") pod \"authorino-operator-7b7bb4bc77-9pjrl\" (UID: \"3138ed5e-517d-41c5-8db4-e66c8e8ad523\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:11.662862 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.662831    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt4rp\" (UniqueName: \"kubernetes.io/projected/3138ed5e-517d-41c5-8db4-e66c8e8ad523-kube-api-access-tt4rp\") pod \"authorino-operator-7b7bb4bc77-9pjrl\" (UID: \"3138ed5e-517d-41c5-8db4-e66c8e8ad523\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:11.687167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.687138    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt4rp\" (UniqueName: \"kubernetes.io/projected/3138ed5e-517d-41c5-8db4-e66c8e8ad523-kube-api-access-tt4rp\") pod \"authorino-operator-7b7bb4bc77-9pjrl\" (UID: \"3138ed5e-517d-41c5-8db4-e66c8e8ad523\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:11.788049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:11.788019    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:12.112690 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:12.108544    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"]
Oct 29 23:18:12.113539 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:18:12.113508    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3138ed5e_517d_41c5_8db4_e66c8e8ad523.slice/crio-50b5d311512858abd1c9002ea049f59f1c6873f8665297b1b3a6958e99a38e8f WatchSource:0}: Error finding container 50b5d311512858abd1c9002ea049f59f1c6873f8665297b1b3a6958e99a38e8f: Status 404 returned error can't find the container with id 50b5d311512858abd1c9002ea049f59f1c6873f8665297b1b3a6958e99a38e8f
Oct 29 23:18:12.199775 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:12.199723    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:12.329024 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:12.328984    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl" event={"ID":"3138ed5e-517d-41c5-8db4-e66c8e8ad523","Type":"ContainerStarted","Data":"50b5d311512858abd1c9002ea049f59f1c6873f8665297b1b3a6958e99a38e8f"}
Oct 29 23:18:12.645110 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:12.645070    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:14.779200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:14.779162    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"]
Oct 29 23:18:14.788014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:14.787993    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:14.813813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:14.813569    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-znlr8\""
Oct 29 23:18:14.825967 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:14.825942    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"]
Oct 29 23:18:14.894289 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:14.894252    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctw4\" (UniqueName: \"kubernetes.io/projected/f0cf0719-50ae-421c-8a9f-523a76cb1525-kube-api-access-rctw4\") pod \"limitador-operator-controller-manager-5778bb4449-kjkc2\" (UID: \"f0cf0719-50ae-421c-8a9f-523a76cb1525\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:14.995427 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:14.995340    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rctw4\" (UniqueName: \"kubernetes.io/projected/f0cf0719-50ae-421c-8a9f-523a76cb1525-kube-api-access-rctw4\") pod \"limitador-operator-controller-manager-5778bb4449-kjkc2\" (UID: \"f0cf0719-50ae-421c-8a9f-523a76cb1525\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:15.013683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.013649    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rctw4\" (UniqueName: \"kubernetes.io/projected/f0cf0719-50ae-421c-8a9f-523a76cb1525-kube-api-access-rctw4\") pod \"limitador-operator-controller-manager-5778bb4449-kjkc2\" (UID: \"f0cf0719-50ae-421c-8a9f-523a76cb1525\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:15.114906 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.114871    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:15.294318 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.294240    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:15.347009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.346977    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl" event={"ID":"3138ed5e-517d-41c5-8db4-e66c8e8ad523","Type":"ContainerStarted","Data":"e366d61b2fb85e1ea9b9ed6fd242f6c0872d18e0c1a0d8a9477c347c954e7184"}
Oct 29 23:18:15.347208 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.347108    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:15.384087 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.384020    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl" podStartSLOduration=1.760320995 podStartE2EDuration="4.384001863s" totalImagesPullingTime="2.623680868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:15.382531255 +0000 UTC m=+306.693775578" watchObservedRunningTime="2026-10-29 23:18:15.384001863 +0000 UTC m=+306.695246191"
Oct 29 23:18:15.417102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:15.416950    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"]
Oct 29 23:18:15.420084 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:18:15.420051    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cf0719_50ae_421c_8a9f_523a76cb1525.slice/crio-bc49dfa97c74fa0d7660076f4c3a296288832b718cbf7fc1f329ce1e7bcc1c9c WatchSource:0}: Error finding container bc49dfa97c74fa0d7660076f4c3a296288832b718cbf7fc1f329ce1e7bcc1c9c: Status 404 returned error can't find the container with id bc49dfa97c74fa0d7660076f4c3a296288832b718cbf7fc1f329ce1e7bcc1c9c
Oct 29 23:18:16.354617 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:16.354339    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc" event={"ID":"761f5568-5049-4c79-b02c-9fd14fbe5009","Type":"ContainerStarted","Data":"51a9444a88ca18c86e448435f20813114e063dbf542e3b9fd5a4e660e30949ce"}
Oct 29 23:18:16.356509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:16.356269    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2" event={"ID":"f0cf0719-50ae-421c-8a9f-523a76cb1525","Type":"ContainerStarted","Data":"bc49dfa97c74fa0d7660076f4c3a296288832b718cbf7fc1f329ce1e7bcc1c9c"}
Oct 29 23:18:16.387864 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:16.387724    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-j9gfc" podStartSLOduration=1.571858054 podStartE2EDuration="6.38771082s" totalImagesPullingTime="4.815852766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:16.386317491 +0000 UTC m=+307.697561817" watchObservedRunningTime="2026-10-29 23:18:16.38771082 +0000 UTC m=+307.698955144"
Oct 29 23:18:17.147859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:17.147768    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:17.362253 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:17.362217    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2" event={"ID":"f0cf0719-50ae-421c-8a9f-523a76cb1525","Type":"ContainerStarted","Data":"f8f6bdce672a2726edd0739e6e665a2f72d85dd88b00c53f67fb2354ef6e5749"}
Oct 29 23:18:17.362703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:17.362376    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:17.423252 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:17.423160    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2" podStartSLOduration=1.961712605 podStartE2EDuration="3.423144033s" totalImagesPullingTime="1.461431428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:17.421937897 +0000 UTC m=+308.733182221" watchObservedRunningTime="2026-10-29 23:18:17.423144033 +0000 UTC m=+308.734388423"
Oct 29 23:18:19.800972 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:19.800879    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:19.944211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:19.944182    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:20.611048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:20.611009    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:20.852450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:20.852410    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:21.219102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:21.219066    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:21.383918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:21.383866    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:21.926127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:21.926081    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:23.439363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:23.439318    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:23.588348 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:23.588315    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:24.159376 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:24.159338    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:24.314010 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:24.313973    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:24.564217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:24.564186    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:24.966460 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:24.966374    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:25.131881 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.131846    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:25.146106 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.146060    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"]
Oct 29 23:18:25.153605 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.153579    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.178019 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.177972    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"]
Oct 29 23:18:25.190143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190110    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190159    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190357 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190287    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d981ea82-7aae-4e46-8b3b-16eefae200ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190357 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190334    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190435 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190405    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vx96\" (UniqueName: \"kubernetes.io/projected/d981ea82-7aae-4e46-8b3b-16eefae200ca-kube-api-access-5vx96\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190453    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190587 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190534    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190613    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.190696 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.190655    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.234582 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.234558    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-k82rd\""
Oct 29 23:18:25.291060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291017    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:25.291248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291072    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291128    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291169    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291207    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291245    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291278    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291311    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d981ea82-7aae-4e46-8b3b-16eefae200ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291354    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291395    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vx96\" (UniqueName: \"kubernetes.io/projected/d981ea82-7aae-4e46-8b3b-16eefae200ca-kube-api-access-5vx96\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291599    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.291777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.291647    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.292047 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.292020    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-data\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.292144 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.292115    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.292332 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.292306    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d981ea82-7aae-4e46-8b3b-16eefae200ca-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.293915 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.293893    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.294010 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.293899    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.311624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.311598    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d981ea82-7aae-4e46-8b3b-16eefae200ca-istio-token\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.312046 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.312025    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vx96\" (UniqueName: \"kubernetes.io/projected/d981ea82-7aae-4e46-8b3b-16eefae200ca-kube-api-access-5vx96\") pod \"data-science-gateway-data-science-gateway-class-858f55f4d96mbr2\" (UID: \"d981ea82-7aae-4e46-8b3b-16eefae200ca\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.470205 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.470170    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:25.541313 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.541191    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:25.777434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.777405    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"]
Oct 29 23:18:25.779415 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:18:25.779389    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd981ea82_7aae_4e46_8b3b_16eefae200ca.slice/crio-f1998ba1572eb33c71f0b21626931942818e3e4bc4a39531d919307852e2f2e6 WatchSource:0}: Error finding container f1998ba1572eb33c71f0b21626931942818e3e4bc4a39531d919307852e2f2e6: Status 404 returned error can't find the container with id f1998ba1572eb33c71f0b21626931942818e3e4bc4a39531d919307852e2f2e6
Oct 29 23:18:25.781399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.781369    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:18:25.781493 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.781434    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:18:25.781539 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:25.781498    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:18:26.359557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.359531    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-9pjrl"
Oct 29 23:18:26.403039 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.403001    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2" event={"ID":"d981ea82-7aae-4e46-8b3b-16eefae200ca","Type":"ContainerStarted","Data":"03bfc4f5d3e998f8a75bb3774c5c73e4a9129ac43099178233ebbc6adeadad45"}
Oct 29 23:18:26.403234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.403065    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2" event={"ID":"d981ea82-7aae-4e46-8b3b-16eefae200ca","Type":"ContainerStarted","Data":"f1998ba1572eb33c71f0b21626931942818e3e4bc4a39531d919307852e2f2e6"}
Oct 29 23:18:26.444159 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.444106    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2" podStartSLOduration=1.444090349 podStartE2EDuration="1.444090349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:26.442777649 +0000 UTC m=+317.754021987" watchObservedRunningTime="2026-10-29 23:18:26.444090349 +0000 UTC m=+317.755334673"
Oct 29 23:18:26.471310 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.471274    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:26.476804 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.476772    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:26.587884 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:26.587849    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:27.201462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:27.201423    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:27.379634 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:27.379603    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:27.407857 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:27.407828    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:27.408758 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:27.408739    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-858f55f4d96mbr2"
Oct 29 23:18:27.766337 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:27.766301    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:28.369073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.369044    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-kjkc2"
Oct 29 23:18:28.695311 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.695235    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"]
Oct 29 23:18:28.700620 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.700599    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.716749 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.716725    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 29 23:18:28.716880 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.716778    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 29 23:18:28.720184 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.720165    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22cec7aa-978d-464a-a84f-9f0eb0d47c00-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.720270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.720199    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7pvr\" (UniqueName: \"kubernetes.io/projected/22cec7aa-978d-464a-a84f-9f0eb0d47c00-kube-api-access-n7pvr\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.720331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.720309    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22cec7aa-978d-464a-a84f-9f0eb0d47c00-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.720375 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.720361    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22cec7aa-978d-464a-a84f-9f0eb0d47c00-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.747742 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.747708    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"odh-trusted-ca-bundle\""
Oct 29 23:18:28.749702 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.749673    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"]
Oct 29 23:18:28.777133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.777109    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-module-controller-manager-dockercfg-cnm79\""
Oct 29 23:18:28.820784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.820748    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22cec7aa-978d-464a-a84f-9f0eb0d47c00-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.820784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.820791    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22cec7aa-978d-464a-a84f-9f0eb0d47c00-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.821011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.820823    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22cec7aa-978d-464a-a84f-9f0eb0d47c00-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.821011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.820844    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7pvr\" (UniqueName: \"kubernetes.io/projected/22cec7aa-978d-464a-a84f-9f0eb0d47c00-kube-api-access-n7pvr\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.821226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.821206    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22cec7aa-978d-464a-a84f-9f0eb0d47c00-manifests\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.821288 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.821272    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22cec7aa-978d-464a-a84f-9f0eb0d47c00-tmp\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.821640 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.821622    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/22cec7aa-978d-464a-a84f-9f0eb0d47c00-trusted-ca\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:28.840300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:28.840273    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7pvr\" (UniqueName: \"kubernetes.io/projected/22cec7aa-978d-464a-a84f-9f0eb0d47c00-kube-api-access-n7pvr\") pod \"kserve-module-controller-manager-7566cf5fc8-h6xw7\" (UID: \"22cec7aa-978d-464a-a84f-9f0eb0d47c00\") " pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:29.013397 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:29.013371    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:29.321382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:29.321296    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"]
Oct 29 23:18:29.332329 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:18:29.332292    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22cec7aa_978d_464a_a84f_9f0eb0d47c00.slice/crio-8faf74d1a09bfefeef28150b0b108c8b4c7ab353a8e79fd40e7698223144c489 WatchSource:0}: Error finding container 8faf74d1a09bfefeef28150b0b108c8b4c7ab353a8e79fd40e7698223144c489: Status 404 returned error can't find the container with id 8faf74d1a09bfefeef28150b0b108c8b4c7ab353a8e79fd40e7698223144c489
Oct 29 23:18:29.417429 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:29.417393    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7" event={"ID":"22cec7aa-978d-464a-a84f-9f0eb0d47c00","Type":"ContainerStarted","Data":"8faf74d1a09bfefeef28150b0b108c8b4c7ab353a8e79fd40e7698223144c489"}
Oct 29 23:18:32.434939 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:32.434893    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7" event={"ID":"22cec7aa-978d-464a-a84f-9f0eb0d47c00","Type":"ContainerStarted","Data":"57d3d548fb8eb9ec44862b2fe5cb0c14871c687382a53e1a79d9f3dd5e025f81"}
Oct 29 23:18:32.435410 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:32.435023    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:32.483337 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:32.483294    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7" podStartSLOduration=2.322074718 podStartE2EDuration="4.483282303s" totalImagesPullingTime="2.161207585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:32.482377426 +0000 UTC m=+323.793621750" watchObservedRunningTime="2026-10-29 23:18:32.483282303 +0000 UTC m=+323.794526627"
Oct 29 23:18:33.008404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:33.008376    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:33.164378 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:33.164340    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:36.006181 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:36.006143    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:36.147160 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:36.147122    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:40.526093 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:18:40.526058    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:18:40.552441 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:40.552405    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:40.696706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:40.696660    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:41.123397 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.123363    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"]
Oct 29 23:18:41.127131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.127109    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.149697 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.149663    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 29 23:18:41.149830 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.149735    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Oct 29 23:18:41.149830 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.149735    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 29 23:18:41.149830 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.149800    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Oct 29 23:18:41.150221 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.150199    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Oct 29 23:18:41.158461 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.158438    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-4n4lv\""
Oct 29 23:18:41.160132 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.160112    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"]
Oct 29 23:18:41.228552 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.228525    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-metrics-certs\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.228713 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.228562    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmnc6\" (UniqueName: \"kubernetes.io/projected/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-kube-api-access-lmnc6\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.228713 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.228583    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-manager-config\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.228850 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.228764    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-cert\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.329581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.329548    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-metrics-certs\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.329711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.329584    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmnc6\" (UniqueName: \"kubernetes.io/projected/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-kube-api-access-lmnc6\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.329711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.329608    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-manager-config\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.329711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.329666    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-cert\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.330396 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.330371    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-manager-config\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.332240 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.332213    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-cert\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.332328 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.332213    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-metrics-certs\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.348538 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.348516    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmnc6\" (UniqueName: \"kubernetes.io/projected/b3e08d67-cdc0-411b-b4d2-f4abd99f2498-kube-api-access-lmnc6\") pod \"jobset-controller-manager-5c68dfb46b-rxwzb\" (UID: \"b3e08d67-cdc0-411b-b4d2-f4abd99f2498\") " pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.438721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.438646    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:41.729975 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:41.729949    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"]
Oct 29 23:18:41.731801 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:18:41.731766    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e08d67_cdc0_411b_b4d2_f4abd99f2498.slice/crio-d9de1cb756c396c4c59094c7e360b21f51df46226bd054ba486daf4f1ee0c0ef WatchSource:0}: Error finding container d9de1cb756c396c4c59094c7e360b21f51df46226bd054ba486daf4f1ee0c0ef: Status 404 returned error can't find the container with id d9de1cb756c396c4c59094c7e360b21f51df46226bd054ba486daf4f1ee0c0ef
Oct 29 23:18:42.482089 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:42.482055    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb" event={"ID":"b3e08d67-cdc0-411b-b4d2-f4abd99f2498","Type":"ContainerStarted","Data":"d9de1cb756c396c4c59094c7e360b21f51df46226bd054ba486daf4f1ee0c0ef"}
Oct 29 23:18:44.493530 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:44.493490    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb" event={"ID":"b3e08d67-cdc0-411b-b4d2-f4abd99f2498","Type":"ContainerStarted","Data":"9558f204a6badcd1305de12b86f7ed546841c5774a968a184f23c0d2110d7016"}
Oct 29 23:18:44.493959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:44.493689    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:44.529926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:44.529869    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb" podStartSLOduration=0.907642256 podStartE2EDuration="3.529855599s" totalImagesPullingTime="2.622213343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:18:44.52758206 +0000 UTC m=+335.838826385" watchObservedRunningTime="2026-10-29 23:18:44.529855599 +0000 UTC m=+335.841099923"
Oct 29 23:18:49.721796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:49.721753    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:51.647209 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:51.647160    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:18:53.440828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:53.440796    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-module-controller-manager-7566cf5fc8-h6xw7"
Oct 29 23:18:55.502874 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:55.502844    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-5c68dfb46b-rxwzb"
Oct 29 23:18:58.505616 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:18:58.505583    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:07.225264 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:07.225218    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:07.366795 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:07.366758    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:07.983689 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:07.983650    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:10.525233 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:19:10.525199    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:19:23.991534 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:23.991498    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:24.134148 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:24.134107    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:24.296558 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:24.296471    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:24.436253 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:24.436211    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:24.675993 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:24.675908    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:26.521524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:26.521464    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:26.680991 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:26.680951    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:26.833700 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:26.833624    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:26.982048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:26.982009    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:30.464123 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:30.464086    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:30.614750 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:30.614708    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:32.277035 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:32.276999    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:32.428558 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:32.428517    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:38.542545 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:38.542511    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:38.749348 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:38.749317    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:19:40.526641 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:19:40.526606    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:19:58.631001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:19:58.630916    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:00.745370 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:00.745334    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:00.896629 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:00.896599    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:02.158619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:02.158581    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:02.303117 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:02.303077    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:02.442596 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:02.442515    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:10.528141 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:20:10.528107    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:20:12.357096 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:12.357058    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:12.526716 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:12.526675    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:20:40.526001 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:20:40.525960    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:20:58.751820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:20:58.751781    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:09.317753 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:09.317708    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:09.450753 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:09.450713    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:10.526601 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:21:10.526571    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:21:13.648127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:13.648093    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:13.811216 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:13.811177    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:37.909588 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:37.909550    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:38.417703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:38.417671    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:39.680847 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:39.680814    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:39.819680 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:39.819646    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:40.525921 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:21:40.525884    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:21:44.599357 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:44.599313    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:48.224950 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:48.224914    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:51.393208 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.393160    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"]
Oct 29 23:21:51.398774 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.398745    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.426560 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.426530    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 29 23:21:51.426767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.426647    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lzw2b\""
Oct 29 23:21:51.426767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.426654    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 29 23:21:51.426767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.426720    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 29 23:21:51.428619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.428597    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"]
Oct 29 23:21:51.430674 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.430649    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7k7\" (UniqueName: \"kubernetes.io/projected/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-kube-api-access-jp7k7\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.430737 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.430699    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.430860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.430843    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.430905 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.430878    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.430960 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.430934    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.431013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.430986    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.499657 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.499610    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:51.531633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.531598    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.531633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.531632    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.531819 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.531688    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7k7\" (UniqueName: \"kubernetes.io/projected/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-kube-api-access-jp7k7\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.531819 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.531710    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.531819 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.531788    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.531819 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.531808    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.532244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.532221    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.532244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.532239    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.532406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.532283    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.534079 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.534057    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.534258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.534241    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.549603 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.549578    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7k7\" (UniqueName: \"kubernetes.io/projected/80cf30d8-9fce-4b84-b53d-74c2e8653ce6-kube-api-access-jp7k7\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-pr2jg\" (UID: \"80cf30d8-9fce-4b84-b53d-74c2e8653ce6\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:51.712689 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:51.712607    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:52.005851 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.005817    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"]
Oct 29 23:21:52.007998 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:21:52.007972    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80cf30d8_9fce_4b84_b53d_74c2e8653ce6.slice/crio-bfa251ec363737792f88347235df92d2fdb5e01da3bc918037f7d578bdb5ca7b WatchSource:0}: Error finding container bfa251ec363737792f88347235df92d2fdb5e01da3bc918037f7d578bdb5ca7b: Status 404 returned error can't find the container with id bfa251ec363737792f88347235df92d2fdb5e01da3bc918037f7d578bdb5ca7b
Oct 29 23:21:52.364090 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.364014    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg" event={"ID":"80cf30d8-9fce-4b84-b53d-74c2e8653ce6","Type":"ContainerStarted","Data":"bfa251ec363737792f88347235df92d2fdb5e01da3bc918037f7d578bdb5ca7b"}
Oct 29 23:21:52.809805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.809768    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"]
Oct 29 23:21:52.814067 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.814036    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.843391 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843340    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 29 23:21:52.843765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843736    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.843896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843792    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.843896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843825    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.843896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843891    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.844049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843937    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.844049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.843960    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clz2k\" (UniqueName: \"kubernetes.io/projected/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-kube-api-access-clz2k\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.845650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.845626    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"]
Oct 29 23:21:52.943399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.943361    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:52.944498 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944457    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944618 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944544    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944618 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944574    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clz2k\" (UniqueName: \"kubernetes.io/projected/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-kube-api-access-clz2k\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944655    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944689    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944819 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944727    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944888    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.944994 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.944969    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.945098 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.945081    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.947244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.947218    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.947751 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.947725    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:52.964284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:52.964260    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clz2k\" (UniqueName: \"kubernetes.io/projected/61d25ac9-78a3-4ca9-80d0-7f78918fcc02-kube-api-access-clz2k\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-pkr9m\" (UID: \"61d25ac9-78a3-4ca9-80d0-7f78918fcc02\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:53.133535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:53.133502    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:53.370718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:53.370633    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg" event={"ID":"80cf30d8-9fce-4b84-b53d-74c2e8653ce6","Type":"ContainerStarted","Data":"ae9507e863781100a352204f695e328c9e67837c0334c522913d3a1ee2b4acfb"}
Oct 29 23:21:53.414140 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:53.414072    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg" podStartSLOduration=1.402854056 podStartE2EDuration="2.41405435s" totalImagesPullingTime="1.011200294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:53.412208246 +0000 UTC m=+524.723452570" watchObservedRunningTime="2026-10-29 23:21:53.41405435 +0000 UTC m=+524.725298675"
Oct 29 23:21:53.425434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:53.425409    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"]
Oct 29 23:21:53.427822 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:21:53.427788    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61d25ac9_78a3_4ca9_80d0_7f78918fcc02.slice/crio-abfddefe4b612e75c0542689bb4269dce74f0a7718659b312aa9fbd944022398 WatchSource:0}: Error finding container abfddefe4b612e75c0542689bb4269dce74f0a7718659b312aa9fbd944022398: Status 404 returned error can't find the container with id abfddefe4b612e75c0542689bb4269dce74f0a7718659b312aa9fbd944022398
Oct 29 23:21:53.713094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:53.713058    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:21:53.807594 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:53.807546    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:54.377418 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:54.377375    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m" event={"ID":"61d25ac9-78a3-4ca9-80d0-7f78918fcc02","Type":"ContainerStarted","Data":"1ef69bb08991dc0940b0444073c68391563fd93916c3f33437c4ecb9bb579f8b"}
Oct 29 23:21:54.377849 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:54.377443    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m" event={"ID":"61d25ac9-78a3-4ca9-80d0-7f78918fcc02","Type":"ContainerStarted","Data":"abfddefe4b612e75c0542689bb4269dce74f0a7718659b312aa9fbd944022398"}
Oct 29 23:21:54.416299 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:54.416244    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m" podStartSLOduration=2.234853204 podStartE2EDuration="2.416233248s" totalImagesPullingTime="181.380044ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:21:54.415232508 +0000 UTC m=+525.726476821" watchObservedRunningTime="2026-10-29 23:21:54.416233248 +0000 UTC m=+525.727477572"
Oct 29 23:21:55.134218 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:55.134179    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:21:55.383256 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:55.383228    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:57.945373 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.945335    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-95cl9"]
Oct 29 23:21:57.949705 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.949682    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:57.974548 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.974523    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 29 23:21:57.976822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.976799    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-95cl9"]
Oct 29 23:21:57.979973 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.979951    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:57.980060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.979999    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:57.980106 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.980062    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:57.980178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.980157    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-home\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:57.980215 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.980186    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:57.980262 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:57.980221    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tzqj\" (UniqueName: \"kubernetes.io/projected/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-kube-api-access-6tzqj\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.048384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.048351    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:58.081466 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081434    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-home\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081466 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081466    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081518    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tzqj\" (UniqueName: \"kubernetes.io/projected/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-kube-api-access-6tzqj\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081555    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081584    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081608    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081893 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081859    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-home\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.081958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.081943    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.082067 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.082041    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.083927 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.083909    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.084090 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.084074    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.099575 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.099548    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tzqj\" (UniqueName: \"kubernetes.io/projected/96fb601e-a2a6-4f78-afa9-a32b77f4c22d-kube-api-access-6tzqj\") pod \"echo-simulator-kserve-64b6f8f96c-95cl9\" (UID: \"96fb601e-a2a6-4f78-afa9-a32b77f4c22d\") " pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.264804 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.264774    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:21:58.559616 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.559584    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-95cl9"]
Oct 29 23:21:58.561677 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:21:58.561647    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fb601e_a2a6_4f78_afa9_a32b77f4c22d.slice/crio-3ced3b3c9e31786f25ca0855b2c7310c7196f45a1bbb084f74f2bcb8ca2c9935 WatchSource:0}: Error finding container 3ced3b3c9e31786f25ca0855b2c7310c7196f45a1bbb084f74f2bcb8ca2c9935: Status 404 returned error can't find the container with id 3ced3b3c9e31786f25ca0855b2c7310c7196f45a1bbb084f74f2bcb8ca2c9935
Oct 29 23:21:58.862052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:58.861977    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:21:59.404914 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:59.404864    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9" event={"ID":"96fb601e-a2a6-4f78-afa9-a32b77f4c22d","Type":"ContainerStarted","Data":"3ced3b3c9e31786f25ca0855b2c7310c7196f45a1bbb084f74f2bcb8ca2c9935"}
Oct 29 23:21:59.809417 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:21:59.809374    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:00.411678 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.411593    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9" event={"ID":"96fb601e-a2a6-4f78-afa9-a32b77f4c22d","Type":"ContainerStarted","Data":"8cb9a2b7f8d3228be36284a0c0a6469f1f92a45c0e54bd1f257dd0b2983fd16a"}
Oct 29 23:22:00.450706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.450652    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9" podStartSLOduration=1.929318981 podStartE2EDuration="3.450638587s" totalImagesPullingTime="1.521319606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:21:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:00.44984794 +0000 UTC m=+531.761092266" watchObservedRunningTime="2026-10-29 23:22:00.450638587 +0000 UTC m=+531.761882911"
Oct 29 23:22:00.869448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.869418    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"]
Oct 29 23:22:00.873585 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.873561    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.892037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.892013    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"]
Oct 29 23:22:00.901216 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.901181    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Oct 29 23:22:00.907550 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.907527    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.907662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.907558    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.907662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.907575    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.907743 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.907713    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvggs\" (UniqueName: \"kubernetes.io/projected/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-kube-api-access-mvggs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.907820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.907804    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.907861 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.907845    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:00.974390 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:00.974349    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:01.008830 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.008804    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.008987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.008849    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.008987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.008890    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.008987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.008928    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.008987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.008948    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.009186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.009010    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvggs\" (UniqueName: \"kubernetes.io/projected/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-kube-api-access-mvggs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.009334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.009315    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.009402 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.009382    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.009456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.009397    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.011084 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.011066    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.011446 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.011429    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.027137 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.027116    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvggs\" (UniqueName: \"kubernetes.io/projected/5797dd50-ed80-4ea3-9e36-1ae7d3b5b089-kube-api-access-mvggs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl\" (UID: \"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.189135 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.189053    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:01.265207 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.265183    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:22:01.478945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.478918    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"]
Oct 29 23:22:01.481079 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:01.481043    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5797dd50_ed80_4ea3_9e36_1ae7d3b5b089.slice/crio-ae5acecc61db79d3c057ef257bf686ebefb6344226d3c40a5fc0272f2c771898 WatchSource:0}: Error finding container ae5acecc61db79d3c057ef257bf686ebefb6344226d3c40a5fc0272f2c771898: Status 404 returned error can't find the container with id ae5acecc61db79d3c057ef257bf686ebefb6344226d3c40a5fc0272f2c771898
Oct 29 23:22:01.713097 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.713070    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:22:01.727651 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:01.727628    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:22:02.422822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:02.422781    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl" event={"ID":"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089","Type":"ContainerStarted","Data":"935a50ade37b9e9deaed74e7c3694b4043be675ac9dc04602f06bc341bbc231f"}
Oct 29 23:22:02.422822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:02.422827    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl" event={"ID":"5797dd50-ed80-4ea3-9e36-1ae7d3b5b089","Type":"ContainerStarted","Data":"ae5acecc61db79d3c057ef257bf686ebefb6344226d3c40a5fc0272f2c771898"}
Oct 29 23:22:02.434717 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:02.434689    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-pr2jg"
Oct 29 23:22:02.462044 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:02.461988    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl" podStartSLOduration=2.261490224 podStartE2EDuration="2.461975333s" totalImagesPullingTime="200.485109ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:02.46071699 +0000 UTC m=+533.771961317" watchObservedRunningTime="2026-10-29 23:22:02.461975333 +0000 UTC m=+533.773219693"
Oct 29 23:22:03.134364 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:03.134328    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:22:03.147405 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:03.147378    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:22:03.189816 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:03.189780    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:03.442861 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:03.442792    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-pkr9m"
Oct 29 23:22:08.265872 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:08.265831    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:22:08.278240 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:08.278209    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:22:08.465624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:08.465594    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-95cl9"
Oct 29 23:22:10.527692 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:22:10.527651    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:22:11.190149 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:11.190114    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:11.203263 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:11.203231    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:11.482416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:11.482388    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl"
Oct 29 23:22:15.897313 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:15.897252    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:16.041553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:16.041515    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:17.488027 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:17.487992    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:17.644020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:17.643977    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:24.317584 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.317543    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"]
Oct 29 23:22:24.326127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.326102    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.333429 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.333141    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"]
Oct 29 23:22:24.337685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.337664    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.345692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.345670    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-htpp6\""
Oct 29 23:22:24.356421 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.356394    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"]
Oct 29 23:22:24.361989 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.361962    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"]
Oct 29 23:22:24.421005 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.420971    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0840088d-bf2c-4a83-8452-45806526646c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421005 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421009    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0840088d-bf2c-4a83-8452-45806526646c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421041    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421160    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421194    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421216    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421395 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421257    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs6vd\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421387    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421463 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421429    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421463 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421448    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421584 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421470    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0840088d-bf2c-4a83-8452-45806526646c-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421622 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421586    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421622 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421606    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421624    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421645    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421675    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.421805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421718    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzkm7\" (UniqueName: \"kubernetes.io/projected/0840088d-bf2c-4a83-8452-45806526646c-kube-api-access-dzkm7\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.421805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.421791    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.522675 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522639    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.522675 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522673    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.522936 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522697    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0840088d-bf2c-4a83-8452-45806526646c-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.522936 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522826    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.522936 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522871    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.522936 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522905    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522937    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522962    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.522996    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzkm7\" (UniqueName: \"kubernetes.io/projected/0840088d-bf2c-4a83-8452-45806526646c-kube-api-access-dzkm7\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523055    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523095    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523103    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0840088d-bf2c-4a83-8452-45806526646c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523134    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0840088d-bf2c-4a83-8452-45806526646c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523171    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523221    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523234    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523284    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523318    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523350    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523357    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-credential-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523355    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs6vd\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523599    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.523934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523665    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523756    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.523934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.523920    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-workload-certs\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.524200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.524009    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.524258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.524199    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0840088d-bf2c-4a83-8452-45806526646c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.524312 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.524278    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-istio-data\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.525448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.525418    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.525692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.525675    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.525807 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.525791    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0840088d-bf2c-4a83-8452-45806526646c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.526164 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.526143    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0840088d-bf2c-4a83-8452-45806526646c-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.541605 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.541565    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.541724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.541647    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0840088d-bf2c-4a83-8452-45806526646c-istio-token\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.541786 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.541770    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzkm7\" (UniqueName: \"kubernetes.io/projected/0840088d-bf2c-4a83-8452-45806526646c-kube-api-access-dzkm7\") pod \"maas-default-gateway-openshift-default-7d9897b54c-gg9rd\" (UID: \"0840088d-bf2c-4a83-8452-45806526646c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.542347 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.542332    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs6vd\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd\") pod \"maas-default-gateway-openshift-default-7d9897b54c-h9shn\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.641461 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.641380    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:24.650638 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.650610    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:24.963042 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.963016    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"]
Oct 29 23:22:24.964305 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:24.964269    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0840088d_bf2c_4a83_8452_45806526646c.slice/crio-6b79131912d5672f5135a17c04afc56d0c1547374539284876e90d4b71effb37 WatchSource:0}: Error finding container 6b79131912d5672f5135a17c04afc56d0c1547374539284876e90d4b71effb37: Status 404 returned error can't find the container with id 6b79131912d5672f5135a17c04afc56d0c1547374539284876e90d4b71effb37
Oct 29 23:22:24.965143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.965128    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"]
Oct 29 23:22:24.966790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.966761    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:24.966878 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.966824    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:24.966878 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.966850    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:24.975024 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:24.975000    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9708f6_96e2_4b1f_adcc_03393e374604.slice/crio-a6aab374986639897556ae01cc1914f28e5fe23c30f5fb3e5f8121f3622b3bdb WatchSource:0}: Error finding container a6aab374986639897556ae01cc1914f28e5fe23c30f5fb3e5f8121f3622b3bdb: Status 404 returned error can't find the container with id a6aab374986639897556ae01cc1914f28e5fe23c30f5fb3e5f8121f3622b3bdb
Oct 29 23:22:24.977126 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.977103    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:24.977195 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.977159    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:24.977195 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:24.977186    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:25.549119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.549081    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" event={"ID":"9b9708f6-96e2-4b1f-adcc-03393e374604","Type":"ContainerStarted","Data":"bb64d925895a1ebd3191aaf7bfe0e7751b4bf8194ec190bbc509adaaadeddc46"}
Oct 29 23:22:25.549618 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.549143    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" event={"ID":"9b9708f6-96e2-4b1f-adcc-03393e374604","Type":"ContainerStarted","Data":"a6aab374986639897556ae01cc1914f28e5fe23c30f5fb3e5f8121f3622b3bdb"}
Oct 29 23:22:25.551128 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.551101    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" event={"ID":"0840088d-bf2c-4a83-8452-45806526646c","Type":"ContainerStarted","Data":"054250b113932ee401f551d50c60eb1b163bf8bd2e8395d27d947151a8776395"}
Oct 29 23:22:25.551237 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.551147    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" event={"ID":"0840088d-bf2c-4a83-8452-45806526646c","Type":"ContainerStarted","Data":"6b79131912d5672f5135a17c04afc56d0c1547374539284876e90d4b71effb37"}
Oct 29 23:22:25.626437 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.626371    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podStartSLOduration=1.626355818 podStartE2EDuration="1.626355818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:25.625671273 +0000 UTC m=+556.936915602" watchObservedRunningTime="2026-10-29 23:22:25.626355818 +0000 UTC m=+556.937600142"
Oct 29 23:22:25.641996 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.641971    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:25.651143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.651103    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:25.677502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:25.672839    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podStartSLOduration=1.672818117 podStartE2EDuration="1.672818117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:25.672768101 +0000 UTC m=+556.984012427" watchObservedRunningTime="2026-10-29 23:22:25.672818117 +0000 UTC m=+556.984062443"
Oct 29 23:22:26.643186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:26.643152    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-h9shn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Oct 29 23:22:26.643662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:26.643204    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Oct 29 23:22:26.652381 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:26.652360    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:26.652440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:26.652400    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:27.642606 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:27.642568    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-h9shn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Oct 29 23:22:27.642787 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:27.642629    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Oct 29 23:22:27.651929 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:27.651894    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:27.652272 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:27.651943    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:28.641954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:28.641914    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-h9shn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Oct 29 23:22:28.644111 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:28.641971    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Oct 29 23:22:28.651558 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:28.651530    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:28.651643 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:28.651576    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:29.642159 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:29.642125    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-h9shn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Oct 29 23:22:29.642578 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:29.642180    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Oct 29 23:22:29.651549 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:29.651526    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:29.651643 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:29.651571    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:30.642617 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:30.642585    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-h9shn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Oct 29 23:22:30.643014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:30.642636    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Oct 29 23:22:30.651013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:30.650989    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:30.651108 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:30.651033    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:31.641976 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:31.641932    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-h9shn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Oct 29 23:22:31.642190 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:31.641984    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Oct 29 23:22:31.651289 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:31.651260    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:31.651797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:31.651312    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:32.651002 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:32.650962    5044 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-7d9897b54c-gg9rd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Oct 29 23:22:32.651193 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:32.651044    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd" podUID="0840088d-bf2c-4a83-8452-45806526646c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Oct 29 23:22:33.336123 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:33.336091    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:33.336635 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:33.336598    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:33.337728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:33.337707    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:22:33.655344 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:33.655271    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:33.655602 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:33.655581    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:33.656165 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:33.656147    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-gg9rd"
Oct 29 23:22:40.525459 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:22:40.525419    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:22:43.335945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.335907    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:43.504312 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.504275    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:43.823804 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.823760    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:43.940170 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.940138    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"]
Oct 29 23:22:43.944561 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.944537    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.960992 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.960963    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqbtl\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961117 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961012    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961117 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961087    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961135    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961159    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961291    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961387 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961324    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961387 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961354    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961430    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:43.961768 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.961750    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-85b460de-openshift-default-dockercfg-m9gzk\""
Oct 29 23:22:43.974747 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.974726    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"]
Oct 29 23:22:43.980896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:43.980865    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:44.062587 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.062536    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqbtl\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.063207 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.063179    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.063430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.063406    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.064208 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.064186    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.065356 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.065266    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.065985 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.065925    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.066147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.066111    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.066358 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.066340    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.067169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.067153    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.067273 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.067188    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.067273 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.067249    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.067678 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.067063    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.067678 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.067115    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.068689 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.068669    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.068885 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.068868    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.082761 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.082640    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqbtl\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.085854 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.085825    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.086401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.086377    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token\") pod \"e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") " pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.133894 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.133864    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:44.259158 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.259127    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:44.361225 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.361149    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:44.422678 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.421090    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"]
Oct 29 23:22:44.426148 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.426115    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.442711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.442688    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e687ff69-gw-openshift-default-dockercfg-8ccsg\""
Oct 29 23:22:44.457330 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.457297    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"]
Oct 29 23:22:44.470030 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.469999    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470163 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470032    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470175    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470256    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtw5k\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470294    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470409 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470377    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470466 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470435    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470569 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470550    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.470633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.470574    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.527676 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.527584    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:44.563836 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.563813    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"]
Oct 29 23:22:44.565226 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:44.565193    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode96b053c_d019_4fdc_b6d4_77ccf5a7a173.slice/crio-fa2c80f5fa1df19133834ccd0215183200b4514ed62b01d94bcf33df02860290 WatchSource:0}: Error finding container fa2c80f5fa1df19133834ccd0215183200b4514ed62b01d94bcf33df02860290: Status 404 returned error can't find the container with id fa2c80f5fa1df19133834ccd0215183200b4514ed62b01d94bcf33df02860290
Oct 29 23:22:44.567432 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.567403    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:44.567525 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.567467    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:44.567525 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.567510    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:44.571635 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571605    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571741 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571684    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571741 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571714    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571741 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571738    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571760    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571779    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571846    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.571904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571885    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtw5k\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.572104 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.571911    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.572104 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.572041    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.572231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.572210    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.572285 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.572247    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.572676 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.572654    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.572887 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.572868    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.574706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.574684    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.576883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.576861    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.589598 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.589578    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtw5k\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.589699 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.589683    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token\") pod \"e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") " pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:44.692399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.692358    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:44.694645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.694614    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" event={"ID":"e96b053c-d019-4fdc-b6d4-77ccf5a7a173","Type":"ContainerStarted","Data":"1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"}
Oct 29 23:22:44.694798 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.694664    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" event={"ID":"e96b053c-d019-4fdc-b6d4-77ccf5a7a173","Type":"ContainerStarted","Data":"fa2c80f5fa1df19133834ccd0215183200b4514ed62b01d94bcf33df02860290"}
Oct 29 23:22:44.734666 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.734613    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podStartSLOduration=1.7345979470000001 podStartE2EDuration="1.734597947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:44.733227467 +0000 UTC m=+576.044471791" watchObservedRunningTime="2026-10-29 23:22:44.734597947 +0000 UTC m=+576.045842272"
Oct 29 23:22:44.743760 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:44.743724    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:45.046591 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.046565    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"]
Oct 29 23:22:45.048081 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:45.048051    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15813741_625b_4c17_a9cf_2a13eaaa7351.slice/crio-0533aab3c4600f182e19cb29a29109d2664d03018ba46ffb92c4763e1b527066 WatchSource:0}: Error finding container 0533aab3c4600f182e19cb29a29109d2664d03018ba46ffb92c4763e1b527066: Status 404 returned error can't find the container with id 0533aab3c4600f182e19cb29a29109d2664d03018ba46ffb92c4763e1b527066
Oct 29 23:22:45.050342 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.050310    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:45.050445 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.050384    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:45.050445 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.050425    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:45.111284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.111254    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:45.259365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.259332    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:45.264312 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.264287    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:45.615715 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.615680    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:45.701557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.701518    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" event={"ID":"15813741-625b-4c17-a9cf-2a13eaaa7351","Type":"ContainerStarted","Data":"9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"}
Oct 29 23:22:45.701728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.701581    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" event={"ID":"15813741-625b-4c17-a9cf-2a13eaaa7351","Type":"ContainerStarted","Data":"0533aab3c4600f182e19cb29a29109d2664d03018ba46ffb92c4763e1b527066"}
Oct 29 23:22:45.701852 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.701820    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:45.702927 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.702900    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:22:45.741724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.741679    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podStartSLOduration=1.741667026 podStartE2EDuration="1.741667026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:45.740542744 +0000 UTC m=+577.051787069" watchObservedRunningTime="2026-10-29 23:22:45.741667026 +0000 UTC m=+577.052911350"
Oct 29 23:22:45.744093 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.744069    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:45.761968 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:45.761933    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:46.454291 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:46.454255    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:46.679105 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:46.679070    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:46.749270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:46.749243    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:46.845106 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:46.845067    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:47.711454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:47.711422    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:47.712210 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:47.712189    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:22:48.123138 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.123097    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:48.236320 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.236284    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"]
Oct 29 23:22:48.240797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.240770    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.257909 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.257877    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"]
Oct 29 23:22:48.258866 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.258843    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-46444d59\""
Oct 29 23:22:48.259605 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.259582    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-46444d59-dockercfg-hrt6f\""
Oct 29 23:22:48.277827 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.277799    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:48.313654 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.313623    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwmzv\" (UniqueName: \"kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv\") pod \"payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.313767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.313665    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.414706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.414622    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwmzv\" (UniqueName: \"kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv\") pod \"payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.414706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.414674    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.415823 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.415795    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.436291 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.436260    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwmzv\" (UniqueName: \"kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv\") pod \"payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.446968 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.446941    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:48.553764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.553732    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:48.857763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:48.857737    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"]
Oct 29 23:22:48.859167 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:48.859145    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ef7dba_92a1_4697_9e41_dd1757b8e47d.slice/crio-9730d7605ae0fff4ce4c9044a551e362d350f0607e50f031c6b70ed1626b34ef WatchSource:0}: Error finding container 9730d7605ae0fff4ce4c9044a551e362d350f0607e50f031c6b70ed1626b34ef: Status 404 returned error can't find the container with id 9730d7605ae0fff4ce4c9044a551e362d350f0607e50f031c6b70ed1626b34ef
Oct 29 23:22:49.654773 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:49.654734    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:49.723388 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:49.723355    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp" event={"ID":"63ef7dba-92a1-4697-9e41-dd1757b8e47d","Type":"ContainerStarted","Data":"9730d7605ae0fff4ce4c9044a551e362d350f0607e50f031c6b70ed1626b34ef"}
Oct 29 23:22:49.829086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:49.828989    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:50.115052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.115018    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:50.272037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.271996    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:50.555634 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.555593    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"]
Oct 29 23:22:50.568813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.568783    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.600586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.600501    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"]
Oct 29 23:22:50.604632 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.604605    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-85b460de-dockercfg-n99wp\""
Oct 29 23:22:50.608902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.608876    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-85b460de\""
Oct 29 23:22:50.636586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.636514    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume\") pod \"payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") " pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.636773 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.636745    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l4gz\" (UniqueName: \"kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz\") pod \"payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") " pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.738058 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.738020    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume\") pod \"payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") " pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.738254 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.738128    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l4gz\" (UniqueName: \"kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz\") pod \"payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") " pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.739188 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.739154    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume\") pod \"payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") " pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.757666 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.757632    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l4gz\" (UniqueName: \"kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz\") pod \"payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") " pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:50.911659 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:50.911628    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:51.218334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.218247    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"]
Oct 29 23:22:51.226355 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:51.226321    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f043c70_8688_4b9d_95ff_bca5b70c184a.slice/crio-c9c97e12f0a868a6e9e771d30706470ce43cd6c9037a6494aa5ec5343b28784e WatchSource:0}: Error finding container c9c97e12f0a868a6e9e771d30706470ce43cd6c9037a6494aa5ec5343b28784e: Status 404 returned error can't find the container with id c9c97e12f0a868a6e9e771d30706470ce43cd6c9037a6494aa5ec5343b28784e
Oct 29 23:22:51.482969 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.482930    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:51.735131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.735046    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl" event={"ID":"9f043c70-8688-4b9d-95ff-bca5b70c184a","Type":"ContainerStarted","Data":"41fc99d7148d9145f49fce78b30bb01e6cdd8470f21ea14db03827e3b4dc67e1"}
Oct 29 23:22:51.735131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.735111    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl" event={"ID":"9f043c70-8688-4b9d-95ff-bca5b70c184a","Type":"ContainerStarted","Data":"c9c97e12f0a868a6e9e771d30706470ce43cd6c9037a6494aa5ec5343b28784e"}
Oct 29 23:22:51.735331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.735196    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:22:51.736639 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.736613    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp" event={"ID":"63ef7dba-92a1-4697-9e41-dd1757b8e47d","Type":"ContainerStarted","Data":"943bb31541d2b9238a1f90f1176200c4e827374d87ae569b4763b9f357dda958"}
Oct 29 23:22:51.736763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.736742    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:22:51.774559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.774517    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl" podStartSLOduration=1.774503781 podStartE2EDuration="1.774503781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:51.772396334 +0000 UTC m=+583.083640660" watchObservedRunningTime="2026-10-29 23:22:51.774503781 +0000 UTC m=+583.085748148"
Oct 29 23:22:51.809828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.809786    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp" podStartSLOduration=1.796039734 podStartE2EDuration="3.809774274s" totalImagesPullingTime="2.01373454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:51.809646877 +0000 UTC m=+583.120891202" watchObservedRunningTime="2026-10-29 23:22:51.809774274 +0000 UTC m=+583.121018599"
Oct 29 23:22:51.900134 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:51.900098    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:52.277947 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.277910    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:52.442155 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.442124    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:52.616067 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.615988    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:52.765595 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.765553    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:52.838021 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.837991    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"]
Oct 29 23:22:52.841653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.841630    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:52.856176 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.856152    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e687ff69\""
Oct 29 23:22:52.867512 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.867433    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e687ff69-dockercfg-sr9z6\""
Oct 29 23:22:52.879508 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.876587    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"]
Oct 29 23:22:52.935110 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.935060    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"]
Oct 29 23:22:52.939086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.939065    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:52.959692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.959661    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:52.959840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.959821    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnltc\" (UniqueName: \"kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc\") pod \"payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:52.961222 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.961197    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:52.967105 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.967083    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"]
Oct 29 23:22:52.987868 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.987842    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"]
Oct 29 23:22:52.991930 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:52.991904    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.008907 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.008879    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-83198dc0-openshift-default-dockercfg-wgfkv\""
Oct 29 23:22:53.018136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.018109    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"]
Oct 29 23:22:53.061013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.060983    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061025    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061119    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061271 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061170    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blhn6\" (UniqueName: \"kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6\") pod \"payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") " pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.061271 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061227    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061271 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061262    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:53.061450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061293    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061310    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrv55\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061341    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061407    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.061683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061529    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnltc\" (UniqueName: \"kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc\") pod \"payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:53.061683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061558    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") " pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.061683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.061580    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.062154 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.062130    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:53.080192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.080164    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnltc\" (UniqueName: \"kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc\") pod \"payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:53.118511 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.118049    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:53.155515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.155466    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:53.162134 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162102    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162268 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162139    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrv55\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162268 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162162    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162268 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162259    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162376    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") " pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.162425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162413    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162457    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162572 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162537    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162617 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162575    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162617 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162600    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162653    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blhn6\" (UniqueName: \"kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6\") pod \"payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") " pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.162726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162684    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.162909 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.162883    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.163278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.163253    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.163278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.163265    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume\") pod \"payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") " pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.163420 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.163380    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.163543 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.163524    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.165142 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.165117    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.165293 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.165276    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.181640 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.181584    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrv55\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.182147 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.182121    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token\") pod \"e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") " pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.182829 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.182811    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blhn6\" (UniqueName: \"kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6\") pod \"payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") " pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.252269 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.252234    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.274735 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.274707    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:53.319927 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.319883    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:53.451381 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.451352    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"]
Oct 29 23:22:53.452698 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:53.452673    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7abcd388_dc0e_423a_8472_e06f1500406f.slice/crio-d6746eb58b010841b02d0d45cc2d9669490a66421de9d97d083cd171939d2abb WatchSource:0}: Error finding container d6746eb58b010841b02d0d45cc2d9669490a66421de9d97d083cd171939d2abb: Status 404 returned error can't find the container with id d6746eb58b010841b02d0d45cc2d9669490a66421de9d97d083cd171939d2abb
Oct 29 23:22:53.553324 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.553294    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"]
Oct 29 23:22:53.554198 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:53.554166    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6dd825c_da20_4b68_bec3_b7ecb1856003.slice/crio-602350eedbec10e77c97453a89c343dee2931597b9b23d40d7f89a0349e2154c WatchSource:0}: Error finding container 602350eedbec10e77c97453a89c343dee2931597b9b23d40d7f89a0349e2154c: Status 404 returned error can't find the container with id 602350eedbec10e77c97453a89c343dee2931597b9b23d40d7f89a0349e2154c
Oct 29 23:22:53.624380 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.624353    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"]
Oct 29 23:22:53.627021 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:53.626993    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac0f8fc_f346_4aa8_bf20_02518a801943.slice/crio-68f8cc9b27174ee27cbc9f52b1f4aa47113cbc08dd0487ac05277d728711a441 WatchSource:0}: Error finding container 68f8cc9b27174ee27cbc9f52b1f4aa47113cbc08dd0487ac05277d728711a441: Status 404 returned error can't find the container with id 68f8cc9b27174ee27cbc9f52b1f4aa47113cbc08dd0487ac05277d728711a441
Oct 29 23:22:53.630142 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.630106    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:53.630254 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.630176    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:53.630254 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.630205    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:22:53.663875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.663848    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:53.750222 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.750181    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" event={"ID":"6ac0f8fc-f346-4aa8-bf20-02518a801943","Type":"ContainerStarted","Data":"33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"}
Oct 29 23:22:53.750413 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.750250    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" event={"ID":"6ac0f8fc-f346-4aa8-bf20-02518a801943","Type":"ContainerStarted","Data":"68f8cc9b27174ee27cbc9f52b1f4aa47113cbc08dd0487ac05277d728711a441"}
Oct 29 23:22:53.752172 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.752142    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv" event={"ID":"f6dd825c-da20-4b68-bec3-b7ecb1856003","Type":"ContainerStarted","Data":"4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53"}
Oct 29 23:22:53.752298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.752193    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv" event={"ID":"f6dd825c-da20-4b68-bec3-b7ecb1856003","Type":"ContainerStarted","Data":"602350eedbec10e77c97453a89c343dee2931597b9b23d40d7f89a0349e2154c"}
Oct 29 23:22:53.752298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.752225    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:22:53.753851 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.753827    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh" event={"ID":"7abcd388-dc0e-423a-8472-e06f1500406f","Type":"ContainerStarted","Data":"9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb"}
Oct 29 23:22:53.753942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.753878    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh" event={"ID":"7abcd388-dc0e-423a-8472-e06f1500406f","Type":"ContainerStarted","Data":"d6746eb58b010841b02d0d45cc2d9669490a66421de9d97d083cd171939d2abb"}
Oct 29 23:22:53.753942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.753905    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:22:53.797237 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.797188    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podStartSLOduration=1.7971743249999999 podStartE2EDuration="1.797174325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:53.796742501 +0000 UTC m=+585.107986827" watchObservedRunningTime="2026-10-29 23:22:53.797174325 +0000 UTC m=+585.108418650"
Oct 29 23:22:53.829172 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.829138    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:53.869404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.869333    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh" podStartSLOduration=1.8693106990000001 podStartE2EDuration="1.869310699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:53.859789203 +0000 UTC m=+585.171033532" watchObservedRunningTime="2026-10-29 23:22:53.869310699 +0000 UTC m=+585.180555024"
Oct 29 23:22:53.869888 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.869864    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"]
Oct 29 23:22:53.873938 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.873890    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:53.892221 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.892193    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"]
Oct 29 23:22:53.908846 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.908815    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4afba12a\""
Oct 29 23:22:53.909001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.908988    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4afba12a-dockercfg-gc8sg\""
Oct 29 23:22:53.910332 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.910288    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv" podStartSLOduration=1.910098655 podStartE2EDuration="1.910098655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:53.907986259 +0000 UTC m=+585.219230597" watchObservedRunningTime="2026-10-29 23:22:53.910098655 +0000 UTC m=+585.221342976"
Oct 29 23:22:53.971587 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.971541    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5kb8\" (UniqueName: \"kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8\") pod \"payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") " pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:53.971772 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:53.971622    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume\") pod \"payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") " pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.088504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.074529    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5kb8\" (UniqueName: \"kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8\") pod \"payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") " pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.088504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.076646    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume\") pod \"payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") " pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.088504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.077870    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume\") pod \"payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") " pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.102460 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.100362    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5kb8\" (UniqueName: \"kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8\") pod \"payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") " pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.191729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.191634    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.321171 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.321135    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:54.325805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.325780    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:54.507452 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.507422    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"]
Oct 29 23:22:54.513237 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:54.513206    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb2f1bd_5817_4277_a949_170fd9cbcc93.slice/crio-6071dcc1318563d1c1f333b14325d724c43e66ac73ba4c27e7b8255a3417a265 WatchSource:0}: Error finding container 6071dcc1318563d1c1f333b14325d724c43e66ac73ba4c27e7b8255a3417a265: Status 404 returned error can't find the container with id 6071dcc1318563d1c1f333b14325d724c43e66ac73ba4c27e7b8255a3417a265
Oct 29 23:22:54.764548 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.764447    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82" event={"ID":"efb2f1bd-5817-4277-a949-170fd9cbcc93","Type":"ContainerStarted","Data":"b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a"}
Oct 29 23:22:54.764788 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.764767    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82" event={"ID":"efb2f1bd-5817-4277-a949-170fd9cbcc93","Type":"ContainerStarted","Data":"6071dcc1318563d1c1f333b14325d724c43e66ac73ba4c27e7b8255a3417a265"}
Oct 29 23:22:54.764895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.764883    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:54.765976 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.765955    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:22:54.767760 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.767168    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:22:54.814299 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:54.814245    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82" podStartSLOduration=1.814231076 podStartE2EDuration="1.814231076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:54.813213064 +0000 UTC m=+586.124457389" watchObservedRunningTime="2026-10-29 23:22:54.814231076 +0000 UTC m=+586.125475401"
Oct 29 23:22:55.241852 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:55.241814    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:55.526586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:55.526502    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:55.680527 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:55.678926    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:57.390502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.388855    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:57.657177 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.657089    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:57.747258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.747223    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"]
Oct 29 23:22:57.752277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.752261    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:57.794203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.794167    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-83198dc0\""
Oct 29 23:22:57.804861 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.804835    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-83198dc0-dockercfg-2c6fq\""
Oct 29 23:22:57.807384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.807354    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"]
Oct 29 23:22:57.822312 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.822282    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:57.822916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.822893    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mfl4\" (UniqueName: \"kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4\") pod \"payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:57.822989 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.822942    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:57.924354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.924253    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mfl4\" (UniqueName: \"kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4\") pod \"payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:57.924354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.924328    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:57.925211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.925188    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:57.944561 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:57.944532    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mfl4\" (UniqueName: \"kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4\") pod \"payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:58.110535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:58.109692    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:58.427845 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:58.427774    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"]
Oct 29 23:22:58.429636 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:22:58.429609    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade51751_3639_4958_b51c_36e20c7488f7.slice/crio-a21a65ea24f197308a9b8385f8314c8e5e78f21198d3cbf8ead4b6be80c48035 WatchSource:0}: Error finding container a21a65ea24f197308a9b8385f8314c8e5e78f21198d3cbf8ead4b6be80c48035: Status 404 returned error can't find the container with id a21a65ea24f197308a9b8385f8314c8e5e78f21198d3cbf8ead4b6be80c48035
Oct 29 23:22:58.826930 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:58.826898    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf" event={"ID":"ade51751-3639-4958-b51c-36e20c7488f7","Type":"ContainerStarted","Data":"00b02add24d9e6090938b318b82070526a61d6128fc5cca44f92dcb42e3ac59a"}
Oct 29 23:22:58.827141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:58.826961    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:22:58.827141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:58.826978    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf" event={"ID":"ade51751-3639-4958-b51c-36e20c7488f7","Type":"ContainerStarted","Data":"a21a65ea24f197308a9b8385f8314c8e5e78f21198d3cbf8ead4b6be80c48035"}
Oct 29 23:22:58.896504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:58.895328    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf" podStartSLOduration=1.895296585 podStartE2EDuration="1.895296585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:22:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:22:58.892826398 +0000 UTC m=+590.204070746" watchObservedRunningTime="2026-10-29 23:22:58.895296585 +0000 UTC m=+590.206540912"
Oct 29 23:22:59.060994 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:59.060960    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:22:59.746316 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:22:59.745960    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:01.724101 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:01.724061    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:02.746153 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:02.746122    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:23:02.746671 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:02.746210    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:23:03.446386 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:03.446337    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:03.752682 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:03.752645    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 29 23:23:03.753046 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:03.752729    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 29 23:23:04.769132 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.769097    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:23:04.769628 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.769190    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:23:04.862227 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.862143    5044 generic.go:356] "Generic (PLEG): container finished" podID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerID="9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72" exitCode=0
Oct 29 23:23:04.862227 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.862213    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" event={"ID":"15813741-625b-4c17-a9cf-2a13eaaa7351","Type":"ContainerDied","Data":"9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"}
Oct 29 23:23:04.862655 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.862635    5044 scope.go:122] "RemoveContainer" containerID="9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"
Oct 29 23:23:04.864290 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.864257    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:04.864404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.864347    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:04.864404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:04.864396    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:05.738107 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:05.738064    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:05.889084 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:05.889033    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:05.896681 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:05.896651    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" event={"ID":"15813741-625b-4c17-a9cf-2a13eaaa7351","Type":"ContainerStarted","Data":"2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d"}
Oct 29 23:23:06.088176 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:06.088081    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:06.743894 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:06.743863    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:23:06.744133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:06.744105    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 29 23:23:06.744208 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:06.744181    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 29 23:23:06.798785 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:06.798752    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:23:07.292173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.292119    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"]
Oct 29 23:23:07.296557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.296539    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.302643 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.302583    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"]
Oct 29 23:23:07.310922 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.310739    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:23:07.310922 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.310883    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:23:07.322027 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.322005    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:23:07.322027 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.322013    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:23:07.339436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.339408    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.339565 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.339458    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.339614 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.339562    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbff7\" (UniqueName: \"kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.441148 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.441061    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.441148 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.441121    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.441368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.441285    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbff7\" (UniqueName: \"kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.441710 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.441690    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.443450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.443429    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.487793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.487706    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbff7\" (UniqueName: \"kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7\") pod \"maas-api-revoke-keys-e2e-ait-85b460de-tq7v5\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.636330 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.636293    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:07.744874 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.744782    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 29 23:23:07.744874 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.744850    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 29 23:23:07.909167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.909131    5044 generic.go:356] "Generic (PLEG): container finished" podID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerID="1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273" exitCode=0
Oct 29 23:23:07.909344 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.909203    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" event={"ID":"e96b053c-d019-4fdc-b6d4-77ccf5a7a173","Type":"ContainerDied","Data":"1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"}
Oct 29 23:23:07.909624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.909605    5044 scope.go:122] "RemoveContainer" containerID="1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"
Oct 29 23:23:07.910933 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.910908    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:07.911011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.910975    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:07.911011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.911005    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:07.942154 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.942128    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:07.986663 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:07.986603    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e93a84b_5c15_46c3_a12e_2fcd00c7a71a.slice/crio-cccf290090e43f0e1f9a3ce8ff296d2c95693646796a34bce2e43ea3a6fbb598 WatchSource:0}: Error finding container cccf290090e43f0e1f9a3ce8ff296d2c95693646796a34bce2e43ea3a6fbb598: Status 404 returned error can't find the container with id cccf290090e43f0e1f9a3ce8ff296d2c95693646796a34bce2e43ea3a6fbb598
Oct 29 23:23:07.993817 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:07.992919    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"]
Oct 29 23:23:08.744629 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:08.744597    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 29 23:23:08.745017 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:08.744647    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 29 23:23:08.939980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:08.939941    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5" event={"ID":"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a","Type":"ContainerStarted","Data":"cccf290090e43f0e1f9a3ce8ff296d2c95693646796a34bce2e43ea3a6fbb598"}
Oct 29 23:23:08.944987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:08.944956    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" event={"ID":"e96b053c-d019-4fdc-b6d4-77ccf5a7a173","Type":"ContainerStarted","Data":"da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2"}
Oct 29 23:23:08.988514 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:08.987275    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:23:09.018120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.018049    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:23:09.259651 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.259616    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:23:09.259820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.259803    5044 patch_prober.go:29] interesting pod/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 29 23:23:09.259864 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.259850    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 29 23:23:09.745167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.745128    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 29 23:23:09.745648 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.745193    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 29 23:23:09.833491 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:09.833446    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:23:10.099556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:10.091368    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:10.260246 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:10.260112    5044 patch_prober.go:29] interesting pod/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 29 23:23:10.260246 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:10.260170    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 29 23:23:10.547757 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:10.547678    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:23:10.744864 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:10.744819    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Oct 29 23:23:10.745029 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:10.744906    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Oct 29 23:23:11.259586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:11.259556    5044 patch_prober.go:29] interesting pod/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 29 23:23:11.260444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:11.260076    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 29 23:23:11.748316 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:11.748290    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:23:11.748697 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:11.748676    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:23:11.749268 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:11.749251    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:23:12.084513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:12.081043    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:12.260171 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:12.259850    5044 patch_prober.go:29] interesting pod/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 29 23:23:12.260171 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:12.259900    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 29 23:23:13.028584 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:13.028547    5044 generic.go:356] "Generic (PLEG): container finished" podID="7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" containerID="e87a1ec3a6a578742658df121e4cf64b7c30a06f85e6684e89797197f360761d" exitCode=0
Oct 29 23:23:13.028757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:13.028703    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5" event={"ID":"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a","Type":"ContainerDied","Data":"e87a1ec3a6a578742658df121e4cf64b7c30a06f85e6684e89797197f360761d"}
Oct 29 23:23:13.259962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:13.259933    5044 patch_prober.go:29] interesting pod/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Oct 29 23:23:13.260178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:13.260155    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Oct 29 23:23:13.917642 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:13.917440    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:14.225258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.225232    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:14.296075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.294836    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca\") pod \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") "
Oct 29 23:23:14.296075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.295042    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca\") pod \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") "
Oct 29 23:23:14.296075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.295099    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7\" (UniqueName: \"kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7\") pod \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\" (UID: \"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a\") "
Oct 29 23:23:14.296674 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.296626    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca" pod "7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" (UID: "7e93a84b-5c15-46c3-a12e-2fcd00c7a71a"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:14.303278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.301666    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:23:14.303278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.302580    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:23:14.304102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.303437    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:23:14.312856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.312811    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca" pod "7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" (UID: "7e93a84b-5c15-46c3-a12e-2fcd00c7a71a"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:23:14.313125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.313097    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7" pod "7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" (UID: "7e93a84b-5c15-46c3-a12e-2fcd00c7a71a"). InnerVolumeSpecName "kube-api-access-jbff7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:14.398505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.396580    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:14.398505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.396615    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbff7\" (UniqueName: \"kubernetes.io/projected/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-kube-api-access-jbff7\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:14.398505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.396630    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:14.419790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.419749    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"]
Oct 29 23:23:14.420264 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.420246    5044 cpu_manager.go:414] "containerMap: removing container" podUID="7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" containerName="revoke-keys"
Oct 29 23:23:14.420264 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.420261    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" containerName="revoke-keys"
Oct 29 23:23:14.420448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.420359    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" containerName="revoke-keys"
Oct 29 23:23:14.423748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.423730    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.443129 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.443102    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"]
Oct 29 23:23:14.499609 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.499574    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxqp\" (UniqueName: \"kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.499831 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.499634    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.499831 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.499757    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.600713 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.600676    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.600883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.600787    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxqp\" (UniqueName: \"kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.600883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.600821    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.601350 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.601328    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.603149 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.603125    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.619121 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.619092    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxqp\" (UniqueName: \"kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp\") pod \"maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:14.745275 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:14.745238    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:15.041872 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:15.041795    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"
Oct 29 23:23:15.042281 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:15.041797    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5" event={"ID":"7e93a84b-5c15-46c3-a12e-2fcd00c7a71a","Type":"ContainerDied","Data":"cccf290090e43f0e1f9a3ce8ff296d2c95693646796a34bce2e43ea3a6fbb598"}
Oct 29 23:23:15.042281 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:15.041940    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cccf290090e43f0e1f9a3ce8ff296d2c95693646796a34bce2e43ea3a6fbb598"
Oct 29 23:23:15.089651 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:15.089622    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"]
Oct 29 23:23:15.091355 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:15.091328    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ee8f29_0abd_4161_8814_f7df1487e137.slice/crio-77ca4d2007aa63d464d7eb5d2c88fbbd4ce851328539c06c27d81c60fb10c62d WatchSource:0}: Error finding container 77ca4d2007aa63d464d7eb5d2c88fbbd4ce851328539c06c27d81c60fb10c62d: Status 404 returned error can't find the container with id 77ca4d2007aa63d464d7eb5d2c88fbbd4ce851328539c06c27d81c60fb10c62d
Oct 29 23:23:15.817302 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:15.817265    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:16.049044 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:16.049010    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw" event={"ID":"51ee8f29-0abd-4161-8814-f7df1487e137","Type":"ContainerStarted","Data":"6c4597666753332a35d8111eb60b4d9ac5369854bdf4de17255b62069f0f3867"}
Oct 29 23:23:16.049470 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:16.049071    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw" event={"ID":"51ee8f29-0abd-4161-8814-f7df1487e137","Type":"ContainerStarted","Data":"77ca4d2007aa63d464d7eb5d2c88fbbd4ce851328539c06c27d81c60fb10c62d"}
Oct 29 23:23:16.090571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:16.090428    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw" podStartSLOduration=2.090388938 podStartE2EDuration="2.090388938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:16.088197629 +0000 UTC m=+607.399441954" watchObservedRunningTime="2026-10-29 23:23:16.090388938 +0000 UTC m=+607.401633262"
Oct 29 23:23:17.056354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:17.056321    5044 generic.go:356] "Generic (PLEG): container finished" podID="51ee8f29-0abd-4161-8814-f7df1487e137" containerID="6c4597666753332a35d8111eb60b4d9ac5369854bdf4de17255b62069f0f3867" exitCode=0
Oct 29 23:23:17.056785 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:17.056413    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw" event={"ID":"51ee8f29-0abd-4161-8814-f7df1487e137","Type":"ContainerDied","Data":"6c4597666753332a35d8111eb60b4d9ac5369854bdf4de17255b62069f0f3867"}
Oct 29 23:23:17.598452 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:17.598412    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:17.825984 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:17.825950    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"]
Oct 29 23:23:17.985012 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:17.984977    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:18.139509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.139418    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:18.230301 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.230270    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:18.348637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.348550    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp\" (UniqueName: \"kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp\") pod \"51ee8f29-0abd-4161-8814-f7df1487e137\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") "
Oct 29 23:23:18.348637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.348615    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca\") pod \"51ee8f29-0abd-4161-8814-f7df1487e137\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") "
Oct 29 23:23:18.348877 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.348708    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca\") pod \"51ee8f29-0abd-4161-8814-f7df1487e137\" (UID: \"51ee8f29-0abd-4161-8814-f7df1487e137\") "
Oct 29 23:23:18.349002 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.348981    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca" pod "51ee8f29-0abd-4161-8814-f7df1487e137" (UID: "51ee8f29-0abd-4161-8814-f7df1487e137"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:18.349150 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.349132    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:18.350803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.350770    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca" pod "51ee8f29-0abd-4161-8814-f7df1487e137" (UID: "51ee8f29-0abd-4161-8814-f7df1487e137"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:23:18.350953 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.350833    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp" pod "51ee8f29-0abd-4161-8814-f7df1487e137" (UID: "51ee8f29-0abd-4161-8814-f7df1487e137"). InnerVolumeSpecName "kube-api-access-8cxqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:18.449940 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.449906    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/51ee8f29-0abd-4161-8814-f7df1487e137-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:18.449940 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.449935    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cxqp\" (UniqueName: \"kubernetes.io/projected/51ee8f29-0abd-4161-8814-f7df1487e137-kube-api-access-8cxqp\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:18.638703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.638615    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"]
Oct 29 23:23:18.670052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.670010    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"]
Oct 29 23:23:18.820397 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.820359    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:18.962825 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:18.962734    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:19.069711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:19.069666    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw" event={"ID":"51ee8f29-0abd-4161-8814-f7df1487e137","Type":"ContainerDied","Data":"77ca4d2007aa63d464d7eb5d2c88fbbd4ce851328539c06c27d81c60fb10c62d"}
Oct 29 23:23:19.069711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:19.069713    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"
Oct 29 23:23:19.069948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:19.069730    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77ca4d2007aa63d464d7eb5d2c88fbbd4ce851328539c06c27d81c60fb10c62d"
Oct 29 23:23:19.492332 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:19.492300    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:20.034018 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.033981    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"]
Oct 29 23:23:20.242630 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.242592    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:20.390935 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.390900    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:20.525060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.525029    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"]
Oct 29 23:23:20.525565 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.525551    5044 cpu_manager.go:414] "containerMap: removing container" podUID="51ee8f29-0abd-4161-8814-f7df1487e137" containerName="revoke-keys"
Oct 29 23:23:20.525627 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.525566    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="51ee8f29-0abd-4161-8814-f7df1487e137" containerName="revoke-keys"
Oct 29 23:23:20.525670 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.525660    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="51ee8f29-0abd-4161-8814-f7df1487e137" containerName="revoke-keys"
Oct 29 23:23:20.528962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.528946    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.549992 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.549961    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"]
Oct 29 23:23:20.558052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.558002    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:23:20.558052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.558018    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:23:20.558052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.558007    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:23:20.558052 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.558011    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:23:20.571892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.571866    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.572060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.571987    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.572188 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.572161    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr5c8\" (UniqueName: \"kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.673718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.673611    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.673718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.673717    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr5c8\" (UniqueName: \"kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.673980 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.673793    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.674323 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.674301    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.676137 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.676117    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.695095 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.695068    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr5c8\" (UniqueName: \"kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8\") pod \"maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:20.858666 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:20.858632    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:21.083367 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.083335    5044 generic.go:356] "Generic (PLEG): container finished" podID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerID="33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54" exitCode=0
Oct 29 23:23:21.083561 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.083406    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" event={"ID":"6ac0f8fc-f346-4aa8-bf20-02518a801943","Type":"ContainerDied","Data":"33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"}
Oct 29 23:23:21.083794 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.083775    5044 scope.go:122] "RemoveContainer" containerID="33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"
Oct 29 23:23:21.084915 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.084891    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:21.084992 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.084975    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:21.085031 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.085006    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:21.163133 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:21.163109    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8326beb_8a10_47fa_ab2f_8f18a88aa094.slice/crio-f248e8e9fdb8841cbc893660ee698db948df266867aa619a079e28bebcc5adcf WatchSource:0}: Error finding container f248e8e9fdb8841cbc893660ee698db948df266867aa619a079e28bebcc5adcf: Status 404 returned error can't find the container with id f248e8e9fdb8841cbc893660ee698db948df266867aa619a079e28bebcc5adcf
Oct 29 23:23:21.163639 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.163616    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"]
Oct 29 23:23:21.408945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:21.408912    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:22.101543 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.101506    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" event={"ID":"6ac0f8fc-f346-4aa8-bf20-02518a801943","Type":"ContainerStarted","Data":"5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795"}
Oct 29 23:23:22.103116 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.103092    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2" event={"ID":"d8326beb-8a10-47fa-ab2f-8f18a88aa094","Type":"ContainerStarted","Data":"7473ab46f620deeb11c9d3c1d75132bf9a52326d3d0c019cc71deb7cfbc56953"}
Oct 29 23:23:22.103200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.103132    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2" event={"ID":"d8326beb-8a10-47fa-ab2f-8f18a88aa094","Type":"ContainerStarted","Data":"f248e8e9fdb8841cbc893660ee698db948df266867aa619a079e28bebcc5adcf"}
Oct 29 23:23:22.189005 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.188946    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2" podStartSLOduration=2.188930703 podStartE2EDuration="2.188930703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:22.187368717 +0000 UTC m=+613.498613041" watchObservedRunningTime="2026-10-29 23:23:22.188930703 +0000 UTC m=+613.500175027"
Oct 29 23:23:22.321011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.320973    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:23:22.322159 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.322136    5044 patch_prober.go:29] interesting pod/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 29 23:23:22.322269 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.322185    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 29 23:23:22.826302 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.826248    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp" podUID="63ef7dba-92a1-4697-9e41-dd1757b8e47d" containerName="payload-pre-processing" containerID="cri-o://943bb31541d2b9238a1f90f1176200c4e827374d87ae569b4763b9f357dda958" gracePeriod=25
Oct 29 23:23:22.944249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:22.944217    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:23.117973 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.117943    5044 generic.go:356] "Generic (PLEG): container finished" podID="63ef7dba-92a1-4697-9e41-dd1757b8e47d" containerID="943bb31541d2b9238a1f90f1176200c4e827374d87ae569b4763b9f357dda958" exitCode=0
Oct 29 23:23:23.118413 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.117974    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp" event={"ID":"63ef7dba-92a1-4697-9e41-dd1757b8e47d","Type":"ContainerDied","Data":"943bb31541d2b9238a1f90f1176200c4e827374d87ae569b4763b9f357dda958"}
Oct 29 23:23:23.119750 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.119727    5044 generic.go:356] "Generic (PLEG): container finished" podID="d8326beb-8a10-47fa-ab2f-8f18a88aa094" containerID="7473ab46f620deeb11c9d3c1d75132bf9a52326d3d0c019cc71deb7cfbc56953" exitCode=0
Oct 29 23:23:23.119886 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.119870    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2" event={"ID":"d8326beb-8a10-47fa-ab2f-8f18a88aa094","Type":"ContainerDied","Data":"7473ab46f620deeb11c9d3c1d75132bf9a52326d3d0c019cc71deb7cfbc56953"}
Oct 29 23:23:23.134811 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.134791    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:23:23.210569 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.210382    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume\") pod \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") "
Oct 29 23:23:23.210569 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.210462    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv\" (UniqueName: \"kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv\") pod \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\" (UID: \"63ef7dba-92a1-4697-9e41-dd1757b8e47d\") "
Oct 29 23:23:23.210905 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.210878    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume" pod "63ef7dba-92a1-4697-9e41-dd1757b8e47d" (UID: "63ef7dba-92a1-4697-9e41-dd1757b8e47d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:23.211153 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.211128    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63ef7dba-92a1-4697-9e41-dd1757b8e47d-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:23.223113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.223067    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv" pod "63ef7dba-92a1-4697-9e41-dd1757b8e47d" (UID: "63ef7dba-92a1-4697-9e41-dd1757b8e47d"). InnerVolumeSpecName "kube-api-access-mwmzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:23.312215 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.312182    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwmzv\" (UniqueName: \"kubernetes.io/projected/63ef7dba-92a1-4697-9e41-dd1757b8e47d-kube-api-access-mwmzv\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:23.321182 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.321152    5044 patch_prober.go:29] interesting pod/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 29 23:23:23.321322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.321215    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 29 23:23:23.325982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.325950    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:23.488252 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.488225    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:23.631767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.631707    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:23.639915 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.639883    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv" podUID="f6dd825c-da20-4b68-bec3-b7ecb1856003" containerName="payload-processing" containerID="cri-o://4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53" gracePeriod=25
Oct 29 23:23:23.672600 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.672562    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh" podUID="7abcd388-dc0e-423a-8472-e06f1500406f" containerName="payload-pre-processing" containerID="cri-o://9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb" gracePeriod=25
Oct 29 23:23:23.790562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.790440    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:23.950285 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:23.950200    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:24.003975 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.003675    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:23:24.028621 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.028597    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:23:24.117173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.117087    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:24.128820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.127937    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc\" (UniqueName: \"kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc\") pod \"7abcd388-dc0e-423a-8472-e06f1500406f\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") "
Oct 29 23:23:24.128820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.127991    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume\") pod \"f6dd825c-da20-4b68-bec3-b7ecb1856003\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") "
Oct 29 23:23:24.128820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.128102    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume\") pod \"7abcd388-dc0e-423a-8472-e06f1500406f\" (UID: \"7abcd388-dc0e-423a-8472-e06f1500406f\") "
Oct 29 23:23:24.128820 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.128131    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6\" (UniqueName: \"kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6\") pod \"f6dd825c-da20-4b68-bec3-b7ecb1856003\" (UID: \"f6dd825c-da20-4b68-bec3-b7ecb1856003\") "
Oct 29 23:23:24.130105 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.129948    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume" pod "7abcd388-dc0e-423a-8472-e06f1500406f" (UID: "7abcd388-dc0e-423a-8472-e06f1500406f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:24.130105 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.130074    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume" pod "f6dd825c-da20-4b68-bec3-b7ecb1856003" (UID: "f6dd825c-da20-4b68-bec3-b7ecb1856003"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:24.132940 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.132679    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6" pod "f6dd825c-da20-4b68-bec3-b7ecb1856003" (UID: "f6dd825c-da20-4b68-bec3-b7ecb1856003"). InnerVolumeSpecName "kube-api-access-blhn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:24.133087 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.133017    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc" pod "7abcd388-dc0e-423a-8472-e06f1500406f" (UID: "7abcd388-dc0e-423a-8472-e06f1500406f"). InnerVolumeSpecName "kube-api-access-pnltc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:24.135259 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.135171    5044 generic.go:356] "Generic (PLEG): container finished" podID="f6dd825c-da20-4b68-bec3-b7ecb1856003" containerID="4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53" exitCode=0
Oct 29 23:23:24.135259 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.135247    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv" event={"ID":"f6dd825c-da20-4b68-bec3-b7ecb1856003","Type":"ContainerDied","Data":"4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53"}
Oct 29 23:23:24.135399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.135313    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv" event={"ID":"f6dd825c-da20-4b68-bec3-b7ecb1856003","Type":"ContainerDied","Data":"602350eedbec10e77c97453a89c343dee2931597b9b23d40d7f89a0349e2154c"}
Oct 29 23:23:24.135399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.135344    5044 scope.go:122] "RemoveContainer" containerID="4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53"
Oct 29 23:23:24.143075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.138063    5044 generic.go:356] "Generic (PLEG): container finished" podID="7abcd388-dc0e-423a-8472-e06f1500406f" containerID="9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb" exitCode=0
Oct 29 23:23:24.143075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.138185    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh" event={"ID":"7abcd388-dc0e-423a-8472-e06f1500406f","Type":"ContainerDied","Data":"9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb"}
Oct 29 23:23:24.143075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.138228    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh" event={"ID":"7abcd388-dc0e-423a-8472-e06f1500406f","Type":"ContainerDied","Data":"d6746eb58b010841b02d0d45cc2d9669490a66421de9d97d083cd171939d2abb"}
Oct 29 23:23:24.143075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.138305    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"
Oct 29 23:23:24.143075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.139611    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"
Oct 29 23:23:24.148510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.145703    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"
Oct 29 23:23:24.148510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.146634    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp" event={"ID":"63ef7dba-92a1-4697-9e41-dd1757b8e47d","Type":"ContainerDied","Data":"9730d7605ae0fff4ce4c9044a551e362d350f0607e50f031c6b70ed1626b34ef"}
Oct 29 23:23:24.148510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.147817    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"]
Oct 29 23:23:24.148510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.148066    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" containerID="cri-o://2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d" gracePeriod=30
Oct 29 23:23:24.156669 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.156649    5044 scope.go:122] "RemoveContainer" containerID="4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53"
Oct 29 23:23:24.156980 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:24.156959    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53\": container with ID starting with 4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53 not found: ID does not exist" containerID="4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53"
Oct 29 23:23:24.157071 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.156991    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53"} err="failed to get container status \"4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53\": rpc error: code = NotFound desc = could not find container \"4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53\": container with ID starting with 4468f013ae67cfec2b0a017ee40d6a753565d843df596f5cd6717df00686ee53 not found: ID does not exist"
Oct 29 23:23:24.157071 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.157015    5044 scope.go:122] "RemoveContainer" containerID="9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb"
Oct 29 23:23:24.199267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.199242    5044 scope.go:122] "RemoveContainer" containerID="9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb"
Oct 29 23:23:24.199827 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:24.199805    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb\": container with ID starting with 9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb not found: ID does not exist" containerID="9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb"
Oct 29 23:23:24.199904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.199840    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb"} err="failed to get container status \"9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb\": rpc error: code = NotFound desc = could not find container \"9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb\": container with ID starting with 9c2953fe757a931ab4ceb115e2ae2a8d09554924588b1e23518784cdb5426ddb not found: ID does not exist"
Oct 29 23:23:24.199904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.199859    5044 scope.go:122] "RemoveContainer" containerID="943bb31541d2b9238a1f90f1176200c4e827374d87ae569b4763b9f357dda958"
Oct 29 23:23:24.214411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.214386    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"]
Oct 29 23:23:24.216666 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.216644    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-e687ff69-699956566b-2m7nv"]
Oct 29 23:23:24.231521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.229123    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7abcd388-dc0e-423a-8472-e06f1500406f-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.231521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.229148    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blhn6\" (UniqueName: \"kubernetes.io/projected/f6dd825c-da20-4b68-bec3-b7ecb1856003-kube-api-access-blhn6\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.231521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.229157    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnltc\" (UniqueName: \"kubernetes.io/projected/7abcd388-dc0e-423a-8472-e06f1500406f-kube-api-access-pnltc\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.231521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.229167    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6dd825c-da20-4b68-bec3-b7ecb1856003-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.296502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.296154    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:24.320904 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.320858    5044 patch_prober.go:29] interesting pod/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 29 23:23:24.321037 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.320919    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 29 23:23:24.331521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.331463    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"]
Oct 29 23:23:24.334141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.334116    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-46444d59-5bdc7f7d67-sslwp"]
Oct 29 23:23:24.345665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.345646    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:24.389891 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.389706    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"]
Oct 29 23:23:24.392742 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.392717    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e687ff69-fcb856679-k2tmh"]
Oct 29 23:23:24.433601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.433573    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8\" (UniqueName: \"kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8\") pod \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") "
Oct 29 23:23:24.433784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.433674    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca\") pod \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") "
Oct 29 23:23:24.433784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.433738    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca\") pod \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\" (UID: \"d8326beb-8a10-47fa-ab2f-8f18a88aa094\") "
Oct 29 23:23:24.434395 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.434363    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca" pod "d8326beb-8a10-47fa-ab2f-8f18a88aa094" (UID: "d8326beb-8a10-47fa-ab2f-8f18a88aa094"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:24.436769 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.436741    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca" pod "d8326beb-8a10-47fa-ab2f-8f18a88aa094" (UID: "d8326beb-8a10-47fa-ab2f-8f18a88aa094"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:23:24.437276 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.437252    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8" pod "d8326beb-8a10-47fa-ab2f-8f18a88aa094" (UID: "d8326beb-8a10-47fa-ab2f-8f18a88aa094"). InnerVolumeSpecName "kube-api-access-vr5c8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:24.448555 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.448536    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:24.491837 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.491799    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"]
Oct 29 23:23:24.494275 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.494248    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-85b460de-tq7v5"]
Oct 29 23:23:24.535452 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.535418    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.535452 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.535446    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d8326beb-8a10-47fa-ab2f-8f18a88aa094-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.535668 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.535462    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr5c8\" (UniqueName: \"kubernetes.io/projected/d8326beb-8a10-47fa-ab2f-8f18a88aa094-kube-api-access-vr5c8\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:24.608761 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.608724    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:24.617209 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.617155    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"]
Oct 29 23:23:24.617455 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.617414    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" containerID="cri-o://da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2" gracePeriod=30
Oct 29 23:23:24.751783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.751738    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:24.769650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.769623    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:23:24.821023 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.820995    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="63ef7dba-92a1-4697-9e41-dd1757b8e47d" path="/var/lib/kubelet/pods/63ef7dba-92a1-4697-9e41-dd1757b8e47d/volumes"
Oct 29 23:23:24.821596 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.821579    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7abcd388-dc0e-423a-8472-e06f1500406f" path="/var/lib/kubelet/pods/7abcd388-dc0e-423a-8472-e06f1500406f/volumes"
Oct 29 23:23:24.822070 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.822057    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7e93a84b-5c15-46c3-a12e-2fcd00c7a71a" path="/var/lib/kubelet/pods/7e93a84b-5c15-46c3-a12e-2fcd00c7a71a/volumes"
Oct 29 23:23:24.822908 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.822892    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f6dd825c-da20-4b68-bec3-b7ecb1856003" path="/var/lib/kubelet/pods/f6dd825c-da20-4b68-bec3-b7ecb1856003/volumes"
Oct 29 23:23:24.934607 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.934572    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"]
Oct 29 23:23:24.991547 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:24.990180    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:25.035447 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.035362    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl" podUID="9f043c70-8688-4b9d-95ff-bca5b70c184a" containerName="payload-processing" containerID="cri-o://41fc99d7148d9145f49fce78b30bb01e6cdd8470f21ea14db03827e3b4dc67e1" gracePeriod=25
Oct 29 23:23:25.142692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.142648    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:25.154939 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.154905    5044 generic.go:356] "Generic (PLEG): container finished" podID="9f043c70-8688-4b9d-95ff-bca5b70c184a" containerID="41fc99d7148d9145f49fce78b30bb01e6cdd8470f21ea14db03827e3b4dc67e1" exitCode=0
Oct 29 23:23:25.155158 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.154966    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl" event={"ID":"9f043c70-8688-4b9d-95ff-bca5b70c184a","Type":"ContainerDied","Data":"41fc99d7148d9145f49fce78b30bb01e6cdd8470f21ea14db03827e3b4dc67e1"}
Oct 29 23:23:25.156551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.156527    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2" event={"ID":"d8326beb-8a10-47fa-ab2f-8f18a88aa094","Type":"ContainerDied","Data":"f248e8e9fdb8841cbc893660ee698db948df266867aa619a079e28bebcc5adcf"}
Oct 29 23:23:25.156716 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.156699    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f248e8e9fdb8841cbc893660ee698db948df266867aa619a079e28bebcc5adcf"
Oct 29 23:23:25.156813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.156552    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"
Oct 29 23:23:25.299417 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.299192    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:25.321346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.321283    5044 patch_prober.go:29] interesting pod/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 29 23:23:25.321506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.321333    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 29 23:23:25.339221 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.339200    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:23:25.444819 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.444789    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz\" (UniqueName: \"kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz\") pod \"9f043c70-8688-4b9d-95ff-bca5b70c184a\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") "
Oct 29 23:23:25.444995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.444884    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume\") pod \"9f043c70-8688-4b9d-95ff-bca5b70c184a\" (UID: \"9f043c70-8688-4b9d-95ff-bca5b70c184a\") "
Oct 29 23:23:25.445490 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.445439    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume" pod "9f043c70-8688-4b9d-95ff-bca5b70c184a" (UID: "9f043c70-8688-4b9d-95ff-bca5b70c184a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:25.447685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.447651    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz" pod "9f043c70-8688-4b9d-95ff-bca5b70c184a" (UID: "9f043c70-8688-4b9d-95ff-bca5b70c184a"). InnerVolumeSpecName "kube-api-access-4l4gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:25.546712 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.546680    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l4gz\" (UniqueName: \"kubernetes.io/projected/9f043c70-8688-4b9d-95ff-bca5b70c184a-kube-api-access-4l4gz\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:25.546712 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.546706    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f043c70-8688-4b9d-95ff-bca5b70c184a-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:25.553813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.553720    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:25.717642 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.717597    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.904316    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"]
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905272    5044 cpu_manager.go:414] "containerMap: removing container" podUID="d8326beb-8a10-47fa-ab2f-8f18a88aa094" containerName="revoke-keys"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905294    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d8326beb-8a10-47fa-ab2f-8f18a88aa094" containerName="revoke-keys"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905325    5044 cpu_manager.go:414] "containerMap: removing container" podUID="7abcd388-dc0e-423a-8472-e06f1500406f" containerName="payload-pre-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905333    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7abcd388-dc0e-423a-8472-e06f1500406f" containerName="payload-pre-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905362    5044 cpu_manager.go:414] "containerMap: removing container" podUID="9f043c70-8688-4b9d-95ff-bca5b70c184a" containerName="payload-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905370    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f043c70-8688-4b9d-95ff-bca5b70c184a" containerName="payload-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905384    5044 cpu_manager.go:414] "containerMap: removing container" podUID="63ef7dba-92a1-4697-9e41-dd1757b8e47d" containerName="payload-pre-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905392    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="63ef7dba-92a1-4697-9e41-dd1757b8e47d" containerName="payload-pre-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905445    5044 cpu_manager.go:414] "containerMap: removing container" podUID="f6dd825c-da20-4b68-bec3-b7ecb1856003" containerName="payload-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905454    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f6dd825c-da20-4b68-bec3-b7ecb1856003" containerName="payload-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905721    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f043c70-8688-4b9d-95ff-bca5b70c184a" containerName="payload-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905742    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="63ef7dba-92a1-4697-9e41-dd1757b8e47d" containerName="payload-pre-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905807    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="f6dd825c-da20-4b68-bec3-b7ecb1856003" containerName="payload-processing"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905861    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="d8326beb-8a10-47fa-ab2f-8f18a88aa094" containerName="revoke-keys"
Oct 29 23:23:25.906434 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.905876    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="7abcd388-dc0e-423a-8472-e06f1500406f" containerName="payload-pre-processing"
Oct 29 23:23:25.910140 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.910121    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.926011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.924198    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-bacddc-openshift-default-dockercfg-xtxwv\""
Oct 29 23:23:25.937939 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.937671    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"]
Oct 29 23:23:25.950384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950357    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950398    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950417    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7rp\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950453    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950522    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950586    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950709    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950766    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.950926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.950791    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:25.991868 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:25.991811    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:26.052553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.052388    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.052976 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.052918    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7rp\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.053923 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.053898    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.054730 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.054710    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.054920 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.054904    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.056228 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.055136    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.056380 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.055585    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.056509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.056225    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.056680 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.056663    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.057559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.057538    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.057919 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.057802    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.061026 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.060863    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.061026 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.060994    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.061227 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.061100    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.061294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.061249    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.061402 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.061356    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.090078 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.090041    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7rp\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.097134 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.097101    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token\") pod \"e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") " pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.137688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.137653    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:26.171713 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.171618    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl" event={"ID":"9f043c70-8688-4b9d-95ff-bca5b70c184a","Type":"ContainerDied","Data":"c9c97e12f0a868a6e9e771d30706470ce43cd6c9037a6494aa5ec5343b28784e"}
Oct 29 23:23:26.172280 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.172260    5044 scope.go:122] "RemoveContainer" containerID="41fc99d7148d9145f49fce78b30bb01e6cdd8470f21ea14db03827e3b4dc67e1"
Oct 29 23:23:26.172559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.172539    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"
Oct 29 23:23:26.229353 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.229250    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:26.236064 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.236039    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"]
Oct 29 23:23:26.243125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.243090    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-85b460de-55cd68c99d-26qvl"]
Oct 29 23:23:26.299253 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.299220    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"]
Oct 29 23:23:26.304125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.304098    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.321161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.321131    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-bed4a2-openshift-default-dockercfg-bgcfk\""
Oct 29 23:23:26.322923 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.321838    5044 patch_prober.go:29] interesting pod/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Oct 29 23:23:26.322923 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.322134    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Oct 29 23:23:26.330035 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.330004    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"]
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370160    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370237    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcbmg\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370286    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370345    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370380    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370450    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370494    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370533    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.391502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.370620    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.412352 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.412284    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486066    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486155    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486193    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486262    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486290    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486327    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486410    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486441    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.493504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.486511    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcbmg\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.494591 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.494568    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.495356 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.495330    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.495463 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.495448    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.495614 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.495589    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.497611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.497566    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.497734 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.497712    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.500001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.499978    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.509243 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.509198    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcbmg\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.515258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.515226    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.588509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.586364    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:26.588509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.587986    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"]
Oct 29 23:23:26.595372 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:26.594861    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36863338_77db_48dd_a2b0_1fe43d26b7dc.slice/crio-d14bf5d3075e8abc0fb035ac398a4c4ea0f857a9990d8bd879b2f940efde8b73 WatchSource:0}: Error finding container d14bf5d3075e8abc0fb035ac398a4c4ea0f857a9990d8bd879b2f940efde8b73: Status 404 returned error can't find the container with id d14bf5d3075e8abc0fb035ac398a4c4ea0f857a9990d8bd879b2f940efde8b73
Oct 29 23:23:26.597169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.597140    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:26.597249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.597204    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:26.597290 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.597260    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:26.626639 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.626617    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:26.744295 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.744207    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:26.751857 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.751828    5044 patch_prober.go:29] interesting pod/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Oct 29 23:23:26.752004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.751887    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:23:26.821882 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.821852    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f043c70-8688-4b9d-95ff-bca5b70c184a" path="/var/lib/kubelet/pods/9f043c70-8688-4b9d-95ff-bca5b70c184a/volumes"
Oct 29 23:23:26.981971 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:26.981308    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d911b59_c9fc_43f4_a254_816ff9818469.slice/crio-9f6f306064a4fb426255d3ac380280dedc9c0edac9a8e6e6675296bb38177ad9 WatchSource:0}: Error finding container 9f6f306064a4fb426255d3ac380280dedc9c0edac9a8e6e6675296bb38177ad9: Status 404 returned error can't find the container with id 9f6f306064a4fb426255d3ac380280dedc9c0edac9a8e6e6675296bb38177ad9
Oct 29 23:23:26.984451 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.984410    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:26.984698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.984673    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:26.984843 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.984823    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:26.985044 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:26.984703    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"]
Oct 29 23:23:27.181951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.181908    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" event={"ID":"36863338-77db-48dd-a2b0-1fe43d26b7dc","Type":"ContainerStarted","Data":"5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"}
Oct 29 23:23:27.182417 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.181980    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" event={"ID":"36863338-77db-48dd-a2b0-1fe43d26b7dc","Type":"ContainerStarted","Data":"d14bf5d3075e8abc0fb035ac398a4c4ea0f857a9990d8bd879b2f940efde8b73"}
Oct 29 23:23:27.184818 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.184777    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" event={"ID":"9d911b59-c9fc-43f4-a254-816ff9818469","Type":"ContainerStarted","Data":"74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"}
Oct 29 23:23:27.184952 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.184828    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" event={"ID":"9d911b59-c9fc-43f4-a254-816ff9818469","Type":"ContainerStarted","Data":"9f6f306064a4fb426255d3ac380280dedc9c0edac9a8e6e6675296bb38177ad9"}
Oct 29 23:23:27.223095 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.223039    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podStartSLOduration=2.223024265 podStartE2EDuration="2.223024265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:27.220707247 +0000 UTC m=+618.531951573" watchObservedRunningTime="2026-10-29 23:23:27.223024265 +0000 UTC m=+618.534268589"
Oct 29 23:23:27.229839 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.229812    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:27.235261 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.235239    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:27.263089 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.262992    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podStartSLOduration=1.262979463 podStartE2EDuration="1.262979463s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:27.259842781 +0000 UTC m=+618.571087107" watchObservedRunningTime="2026-10-29 23:23:27.262979463 +0000 UTC m=+618.574223789"
Oct 29 23:23:27.344836 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.344797    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:23:27.346009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.345988    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:23:27.627687 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:27.627610    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:28.073524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.073465    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:28.191661 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.191630    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:28.192357 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.192333    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:28.632157 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.632128    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:28.659009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.658977    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:28.763552 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.763513    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"]
Oct 29 23:23:28.766655 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.766628    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4afba12a-qr2pw"]
Oct 29 23:23:28.806172 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.806140    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:28.820850 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:28.820823    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="51ee8f29-0abd-4161-8814-f7df1487e137" path="/var/lib/kubelet/pods/51ee8f29-0abd-4161-8814-f7df1487e137/volumes"
Oct 29 23:23:29.197184 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.197145    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:29.198108 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.198090    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:29.304936 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.304898    5044 patch_prober.go:29] interesting pod/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 29 23:23:29.305128 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.304969    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:23:29.427448 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.427421    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:23:29.491687 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.491656    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:29.548516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548487    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548531    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548569    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548605    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548652    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548731    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548771    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548801    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548826    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548840    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548883    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k\") pod \"15813741-625b-4c17-a9cf-2a13eaaa7351\" (UID: \"15813741-625b-4c17-a9cf-2a13eaaa7351\") "
Oct 29 23:23:29.548945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.548924    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.549310 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549204    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:29.549310 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549254    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.549416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549398    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.549459 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549423    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.549459 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549448    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.549577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549461    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.549577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.549505    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15813741-625b-4c17-a9cf-2a13eaaa7351-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.551392 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.551363    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:23:29.551628 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.551502    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "kube-api-access-mtw5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:29.551746 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.551671    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:29.552195 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.552151    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy" pod "15813741-625b-4c17-a9cf-2a13eaaa7351" (UID: "15813741-625b-4c17-a9cf-2a13eaaa7351"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.650984 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.650956    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.650984 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.650984    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.651144 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.650994    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.651144 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.651002    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtw5k\" (UniqueName: \"kubernetes.io/projected/15813741-625b-4c17-a9cf-2a13eaaa7351-kube-api-access-mtw5k\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.653450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.653420    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:29.858530 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.858442    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:23:29.935532 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.935464    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82" podUID="efb2f1bd-5817-4277-a949-170fd9cbcc93" containerName="payload-processing" containerID="cri-o://b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a" gracePeriod=25
Oct 29 23:23:29.954237 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954209    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954369 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954246    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954369 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954312    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954370    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954399    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954441    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954502    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954746 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954602    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954746 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954656    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo\") pod \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\" (UID: \"e96b053c-d019-4fdc-b6d4-77ccf5a7a173\") "
Oct 29 23:23:29.954914 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954654    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.954914 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954746    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.955035 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954849    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.955035 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.954876    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:29.955133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.955039    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:29.955368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.955215    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.955368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.955242    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.955368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.955257    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.955368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.955270    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.955368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.955284    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:29.956729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.956700    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "kube-api-access-dqbtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:29.957031 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.957004    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:29.957119 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.957009    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:23:29.957195 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:29.957182    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy" pod "e96b053c-d019-4fdc-b6d4-77ccf5a7a173" (UID: "e96b053c-d019-4fdc-b6d4-77ccf5a7a173"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:30.056930 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.056902    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:30.057020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.056935    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqbtl\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-kube-api-access-dqbtl\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:30.057020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.056953    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:30.057020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.056967    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e96b053c-d019-4fdc-b6d4-77ccf5a7a173-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:30.072440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.072406    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:30.195839 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.195818    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:23:30.203628 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.203602    5044 generic.go:356] "Generic (PLEG): container finished" podID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerID="da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2" exitCode=0
Oct 29 23:23:30.204013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.203661    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"
Oct 29 23:23:30.204013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.203687    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" event={"ID":"e96b053c-d019-4fdc-b6d4-77ccf5a7a173","Type":"ContainerDied","Data":"da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2"}
Oct 29 23:23:30.204013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.203743    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55" event={"ID":"e96b053c-d019-4fdc-b6d4-77ccf5a7a173","Type":"ContainerDied","Data":"fa2c80f5fa1df19133834ccd0215183200b4514ed62b01d94bcf33df02860290"}
Oct 29 23:23:30.204013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.203771    5044 scope.go:122] "RemoveContainer" containerID="da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2"
Oct 29 23:23:30.205020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.204998    5044 generic.go:356] "Generic (PLEG): container finished" podID="efb2f1bd-5817-4277-a949-170fd9cbcc93" containerID="b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a" exitCode=0
Oct 29 23:23:30.205126 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.205034    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"
Oct 29 23:23:30.205126 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.205069    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82" event={"ID":"efb2f1bd-5817-4277-a949-170fd9cbcc93","Type":"ContainerDied","Data":"b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a"}
Oct 29 23:23:30.205126 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.205113    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82" event={"ID":"efb2f1bd-5817-4277-a949-170fd9cbcc93","Type":"ContainerDied","Data":"6071dcc1318563d1c1f333b14325d724c43e66ac73ba4c27e7b8255a3417a265"}
Oct 29 23:23:30.206895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.206869    5044 generic.go:356] "Generic (PLEG): container finished" podID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerID="2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d" exitCode=0
Oct 29 23:23:30.206994 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.206894    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" event={"ID":"15813741-625b-4c17-a9cf-2a13eaaa7351","Type":"ContainerDied","Data":"2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d"}
Oct 29 23:23:30.206994 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.206934    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"
Oct 29 23:23:30.207270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.206939    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48" event={"ID":"15813741-625b-4c17-a9cf-2a13eaaa7351","Type":"ContainerDied","Data":"0533aab3c4600f182e19cb29a29109d2664d03018ba46ffb92c4763e1b527066"}
Oct 29 23:23:30.224520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.224500    5044 scope.go:122] "RemoveContainer" containerID="1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"
Oct 29 23:23:30.234528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.234510    5044 scope.go:122] "RemoveContainer" containerID="da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2"
Oct 29 23:23:30.234805 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:30.234782    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2\": container with ID starting with da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2 not found: ID does not exist" containerID="da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2"
Oct 29 23:23:30.234916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.234817    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2"} err="failed to get container status \"da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2\": rpc error: code = NotFound desc = could not find container \"da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2\": container with ID starting with da6a10f6acc30166a7f6c24f9f92623e722fb8445b09da091578b38faf0f37d2 not found: ID does not exist"
Oct 29 23:23:30.234916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.234836    5044 scope.go:122] "RemoveContainer" containerID="1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"
Oct 29 23:23:30.235163 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:30.235140    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273\": container with ID starting with 1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273 not found: ID does not exist" containerID="1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"
Oct 29 23:23:30.235223 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.235169    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273"} err="failed to get container status \"1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273\": rpc error: code = NotFound desc = could not find container \"1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273\": container with ID starting with 1379a7521b52f79058ae315b327582c56d831903741837a17a648a9878a82273 not found: ID does not exist"
Oct 29 23:23:30.235223 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.235196    5044 scope.go:122] "RemoveContainer" containerID="b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a"
Oct 29 23:23:30.240144 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.240115    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:30.244623 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.244606    5044 scope.go:122] "RemoveContainer" containerID="b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a"
Oct 29 23:23:30.244882 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:30.244861    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a\": container with ID starting with b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a not found: ID does not exist" containerID="b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a"
Oct 29 23:23:30.244956 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.244892    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a"} err="failed to get container status \"b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a\": rpc error: code = NotFound desc = could not find container \"b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a\": container with ID starting with b15c11dc9441b6cf370dfb72529b9aad9f9cf8e9febbd5426eabce56057bd66a not found: ID does not exist"
Oct 29 23:23:30.244956 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.244915    5044 scope.go:122] "RemoveContainer" containerID="2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d"
Oct 29 23:23:30.254103 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.254079    5044 scope.go:122] "RemoveContainer" containerID="9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"
Oct 29 23:23:30.263411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.263392    5044 scope.go:122] "RemoveContainer" containerID="2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d"
Oct 29 23:23:30.263831 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:30.263813    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d\": container with ID starting with 2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d not found: ID does not exist" containerID="2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d"
Oct 29 23:23:30.263883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.263839    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d"} err="failed to get container status \"2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d\": rpc error: code = NotFound desc = could not find container \"2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d\": container with ID starting with 2308724354aa8c3328dc8353a02a3bed2b6062a2e8087a42e2d356cb6fbb457d not found: ID does not exist"
Oct 29 23:23:30.263883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.263863    5044 scope.go:122] "RemoveContainer" containerID="9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"
Oct 29 23:23:30.264171 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:30.264136    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72\": container with ID starting with 9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72 not found: ID does not exist" containerID="9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"
Oct 29 23:23:30.264255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.264165    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72"} err="failed to get container status \"9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72\": rpc error: code = NotFound desc = could not find container \"9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72\": container with ID starting with 9d841b6382445993a77b4942de451c7ca2422518bcc150e43b181178c3581f72 not found: ID does not exist"
Oct 29 23:23:30.298203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.298174    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"]
Oct 29 23:23:30.303385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.303317    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-85b460de-openshift-default-9b5cf6cc7-x9d55"]
Oct 29 23:23:30.338907 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.338883    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"]
Oct 29 23:23:30.347688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.347660    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e687ff69-gw-openshift-default-f9549464f-c6v48"]
Oct 29 23:23:30.360298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.360266    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8\" (UniqueName: \"kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8\") pod \"efb2f1bd-5817-4277-a949-170fd9cbcc93\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") "
Oct 29 23:23:30.360424 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.360312    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume\") pod \"efb2f1bd-5817-4277-a949-170fd9cbcc93\" (UID: \"efb2f1bd-5817-4277-a949-170fd9cbcc93\") "
Oct 29 23:23:30.360853 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.360825    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume" pod "efb2f1bd-5817-4277-a949-170fd9cbcc93" (UID: "efb2f1bd-5817-4277-a949-170fd9cbcc93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:30.362421 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.362401    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8" pod "efb2f1bd-5817-4277-a949-170fd9cbcc93" (UID: "efb2f1bd-5817-4277-a949-170fd9cbcc93"). InnerVolumeSpecName "kube-api-access-w5kb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:30.386650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.386620    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:30.461774 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.461741    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5kb8\" (UniqueName: \"kubernetes.io/projected/efb2f1bd-5817-4277-a949-170fd9cbcc93-kube-api-access-w5kb8\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:30.461774 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.461769    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb2f1bd-5817-4277-a949-170fd9cbcc93-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:30.551769 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.551738    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"]
Oct 29 23:23:30.559356 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.559289    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4afba12a-6b44759f4-nbc82"]
Oct 29 23:23:30.641847 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.641803    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"]
Oct 29 23:23:30.642310 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642294    5044 cpu_manager.go:414] "containerMap: removing container" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642311    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642321    5044 cpu_manager.go:414] "containerMap: removing container" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642326    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642336    5044 cpu_manager.go:414] "containerMap: removing container" podUID="efb2f1bd-5817-4277-a949-170fd9cbcc93" containerName="payload-processing"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642341    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="efb2f1bd-5817-4277-a949-170fd9cbcc93" containerName="payload-processing"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642349    5044 cpu_manager.go:414] "containerMap: removing container" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642353    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642366    5044 cpu_manager.go:414] "containerMap: removing container" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy"
Oct 29 23:23:30.642379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642371    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy"
Oct 29 23:23:30.642948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642450    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy"
Oct 29 23:23:30.642948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642458    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy"
Oct 29 23:23:30.642948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642464    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="efb2f1bd-5817-4277-a949-170fd9cbcc93" containerName="payload-processing"
Oct 29 23:23:30.642948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642469    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" containerName="istio-proxy"
Oct 29 23:23:30.642948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.642490    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" containerName="istio-proxy"
Oct 29 23:23:30.647444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.647422    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.663590 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.663565    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-b0153c-openshift-default-dockercfg-jp5q8\""
Oct 29 23:23:30.670535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.670511    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"]
Oct 29 23:23:30.735946 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.735919    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:30.764123 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764093    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764137    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764209    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764244    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764269    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq2sq\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764359 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764295    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764462    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764531    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.764585 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.764570    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.827060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.826976    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="15813741-625b-4c17-a9cf-2a13eaaa7351" path="/var/lib/kubelet/pods/15813741-625b-4c17-a9cf-2a13eaaa7351/volumes"
Oct 29 23:23:30.827577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.827558    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e96b053c-d019-4fdc-b6d4-77ccf5a7a173" path="/var/lib/kubelet/pods/e96b053c-d019-4fdc-b6d4-77ccf5a7a173/volumes"
Oct 29 23:23:30.828007 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.827965    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="efb2f1bd-5817-4277-a949-170fd9cbcc93" path="/var/lib/kubelet/pods/efb2f1bd-5817-4277-a949-170fd9cbcc93/volumes"
Oct 29 23:23:30.865053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865030    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865175 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865153    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865252 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865198    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865252 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865246    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865355 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865280    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865355 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865330    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865355 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865330    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865526 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865369    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2sq\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865526 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865406    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865542    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865543    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.865641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.865634    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.866193 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.866168    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.866413 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.866393    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.867598 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.867575    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.867672 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.867630    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.883471 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.883453    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.883721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.883704    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq2sq\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq\") pod \"e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") " pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:30.889404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.889380    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:30.963285 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:30.963249    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:31.034848 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.034816    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:31.103317 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.103222    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"]
Oct 29 23:23:31.249064 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.249019    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:31.271794 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.271770    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"]
Oct 29 23:23:31.272726 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:31.272703    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27d7164_13e0_449d_b22c_2043b844b88a.slice/crio-7c9eb5d114fd51171af8b5241d6e7defd071672da70a460a821e4cc5b10006ea WatchSource:0}: Error finding container 7c9eb5d114fd51171af8b5241d6e7defd071672da70a460a821e4cc5b10006ea: Status 404 returned error can't find the container with id 7c9eb5d114fd51171af8b5241d6e7defd071672da70a460a821e4cc5b10006ea
Oct 29 23:23:31.274894 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.274861    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:31.274978 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.274923    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:31.274978 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.274950    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:31.405324 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:31.405241    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:32.224143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.224105    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" event={"ID":"d27d7164-13e0-449d-b22c-2043b844b88a","Type":"ContainerStarted","Data":"0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"}
Oct 29 23:23:32.224322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.224167    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" event={"ID":"d27d7164-13e0-449d-b22c-2043b844b88a","Type":"ContainerStarted","Data":"7c9eb5d114fd51171af8b5241d6e7defd071672da70a460a821e4cc5b10006ea"}
Oct 29 23:23:32.322449 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.322388    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podStartSLOduration=2.322370541 podStartE2EDuration="2.322370541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:32.316078642 +0000 UTC m=+623.627322967" watchObservedRunningTime="2026-10-29 23:23:32.322370541 +0000 UTC m=+623.633614867"
Oct 29 23:23:32.348729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.348696    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:32.503341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.503248    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:32.963735 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.963658    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:32.969796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:32.969771    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:33.050104 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.050068    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:33.220798 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.220703    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:33.230169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.230146    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:33.230956 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.230939    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:23:33.343101 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.343067    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"]
Oct 29 23:23:33.348049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.348017    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.359821 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.359792    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"]
Oct 29 23:23:33.362633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.361821    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-bed4a2\""
Oct 29 23:23:33.362633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.361866    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-bed4a2-dockercfg-pfnmb\""
Oct 29 23:23:33.371505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.371463    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:33.394264 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.394240    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.394394 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.394272    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhr5n\" (UniqueName: \"kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n\") pod \"payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.494853 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.494820    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.495030 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.494854    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhr5n\" (UniqueName: \"kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n\") pod \"payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.495591 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.495569    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.512905 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.512880    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhr5n\" (UniqueName: \"kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n\") pod \"payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.661704 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.661675    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:33.951727 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:33.951698    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"]
Oct 29 23:23:33.953156 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:33.953130    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48070e48_fe6b_4885_b6bb_7ec7fa898233.slice/crio-9c2223eea79498a746693543d85367f6c4211d27dfb978e624bcc0912e75f58b WatchSource:0}: Error finding container 9c2223eea79498a746693543d85367f6c4211d27dfb978e624bcc0912e75f58b: Status 404 returned error can't find the container with id 9c2223eea79498a746693543d85367f6c4211d27dfb978e624bcc0912e75f58b
Oct 29 23:23:34.256815 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.256771    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" event={"ID":"48070e48-fe6b-4885-b6bb-7ec7fa898233","Type":"ContainerStarted","Data":"5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df"}
Oct 29 23:23:34.257051 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.256852    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:34.257051 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.256880    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" event={"ID":"48070e48-fe6b-4885-b6bb-7ec7fa898233","Type":"ContainerStarted","Data":"9c2223eea79498a746693543d85367f6c4211d27dfb978e624bcc0912e75f58b"}
Oct 29 23:23:34.294471 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.294423    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" podStartSLOduration=1.2944101479999999 podStartE2EDuration="1.294410148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:34.293469699 +0000 UTC m=+625.604714024" watchObservedRunningTime="2026-10-29 23:23:34.294410148 +0000 UTC m=+625.605654484"
Oct 29 23:23:34.656287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.656200    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:34.814082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.814046    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:34.952376 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:34.952292    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:35.079806 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:35.079772    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:35.235946 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:35.235909    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:35.412667 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:35.412623    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:35.576840 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:35.576755    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:36.104184 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.104145    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf" podUID="ade51751-3639-4958-b51c-36e20c7488f7" containerName="payload-pre-processing" containerID="cri-o://00b02add24d9e6090938b318b82070526a61d6128fc5cca44f92dcb42e3ac59a" gracePeriod=25
Oct 29 23:23:36.279377 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.279292    5044 generic.go:356] "Generic (PLEG): container finished" podID="ade51751-3639-4958-b51c-36e20c7488f7" containerID="00b02add24d9e6090938b318b82070526a61d6128fc5cca44f92dcb42e3ac59a" exitCode=0
Oct 29 23:23:36.279720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.279351    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf" event={"ID":"ade51751-3639-4958-b51c-36e20c7488f7","Type":"ContainerDied","Data":"00b02add24d9e6090938b318b82070526a61d6128fc5cca44f92dcb42e3ac59a"}
Oct 29 23:23:36.376146 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.376111    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:23:36.424343 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.424318    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4\" (UniqueName: \"kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4\") pod \"ade51751-3639-4958-b51c-36e20c7488f7\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") "
Oct 29 23:23:36.424506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.424420    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume\") pod \"ade51751-3639-4958-b51c-36e20c7488f7\" (UID: \"ade51751-3639-4958-b51c-36e20c7488f7\") "
Oct 29 23:23:36.424815 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.424789    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume" pod "ade51751-3639-4958-b51c-36e20c7488f7" (UID: "ade51751-3639-4958-b51c-36e20c7488f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:36.426411 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.426382    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4" pod "ade51751-3639-4958-b51c-36e20c7488f7" (UID: "ade51751-3639-4958-b51c-36e20c7488f7"). InnerVolumeSpecName "kube-api-access-2mfl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:36.525581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.525545    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mfl4\" (UniqueName: \"kubernetes.io/projected/ade51751-3639-4958-b51c-36e20c7488f7-kube-api-access-2mfl4\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:36.525581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:36.525574    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ade51751-3639-4958-b51c-36e20c7488f7-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:37.060957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.060915    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:37.212235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.212140    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:37.286191 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.286159    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"
Oct 29 23:23:37.286191 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.286184    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf" event={"ID":"ade51751-3639-4958-b51c-36e20c7488f7","Type":"ContainerDied","Data":"a21a65ea24f197308a9b8385f8314c8e5e78f21198d3cbf8ead4b6be80c48035"}
Oct 29 23:23:37.286407 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.286249    5044 scope.go:122] "RemoveContainer" containerID="00b02add24d9e6090938b318b82070526a61d6128fc5cca44f92dcb42e3ac59a"
Oct 29 23:23:37.334764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.334734    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"]
Oct 29 23:23:37.346166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.346136    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-83198dc0-678c69db5f-9p2sf"]
Oct 29 23:23:37.623281 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.623253    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:37.711876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.711845    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"]
Oct 29 23:23:37.712333 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.712320    5044 cpu_manager.go:414] "containerMap: removing container" podUID="ade51751-3639-4958-b51c-36e20c7488f7" containerName="payload-pre-processing"
Oct 29 23:23:37.712372 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.712334    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ade51751-3639-4958-b51c-36e20c7488f7" containerName="payload-pre-processing"
Oct 29 23:23:37.712417 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.712407    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="ade51751-3639-4958-b51c-36e20c7488f7" containerName="payload-pre-processing"
Oct 29 23:23:37.716967 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.716948    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.732872 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.732852    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-b0153c\""
Oct 29 23:23:37.733951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.733934    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-b0153c-dockercfg-58fdp\""
Oct 29 23:23:37.735267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.735244    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"]
Oct 29 23:23:37.738471 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.738447    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.738614 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.738593    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-297hf\" (UniqueName: \"kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf\") pod \"payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.747577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.747553    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"]
Oct 29 23:23:37.751161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.751144    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:37.774188 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.774157    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"]
Oct 29 23:23:37.786318 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.786286    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:37.843113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.843076    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6mgc\" (UniqueName: \"kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc\") pod \"payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:37.843305 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.843148    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.843305 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.843191    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:37.843305 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.843277    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-297hf\" (UniqueName: \"kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf\") pod \"payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.844307 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.844280    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.862429 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.862398    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-297hf\" (UniqueName: \"kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf\") pod \"payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:37.944613 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.944534    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:37.944760 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.944671    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6mgc\" (UniqueName: \"kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc\") pod \"payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:37.945239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.945218    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:37.969239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:37.969210    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6mgc\" (UniqueName: \"kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc\") pod \"payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:38.029901 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:38.029863    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:38.069765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:38.069735    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:38.337551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:38.335951    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"]
Oct 29 23:23:38.385154 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:38.385129    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"]
Oct 29 23:23:38.394660 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:38.394634    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3461cb13_23de_4a58_9b32_022c9c65aa6b.slice/crio-97f63c13307c5eea2f4b49d53190938b2c6ce2e4f1938159de8608dd75bac2d0 WatchSource:0}: Error finding container 97f63c13307c5eea2f4b49d53190938b2c6ce2e4f1938159de8608dd75bac2d0: Status 404 returned error can't find the container with id 97f63c13307c5eea2f4b49d53190938b2c6ce2e4f1938159de8608dd75bac2d0
Oct 29 23:23:38.823058 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:38.823030    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ade51751-3639-4958-b51c-36e20c7488f7" path="/var/lib/kubelet/pods/ade51751-3639-4958-b51c-36e20c7488f7/volumes"
Oct 29 23:23:38.914298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:38.914268    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:39.300031 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.299997    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" event={"ID":"3461cb13-23de-4a58-9b32-022c9c65aa6b","Type":"ContainerStarted","Data":"f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359"}
Oct 29 23:23:39.300249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.300052    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" event={"ID":"3461cb13-23de-4a58-9b32-022c9c65aa6b","Type":"ContainerStarted","Data":"97f63c13307c5eea2f4b49d53190938b2c6ce2e4f1938159de8608dd75bac2d0"}
Oct 29 23:23:39.300249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.300080    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:39.301627 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.301603    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" event={"ID":"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365","Type":"ContainerStarted","Data":"a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38"}
Oct 29 23:23:39.301729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.301643    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" event={"ID":"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365","Type":"ContainerStarted","Data":"ae84dd8675b0fc776892d8df73cb2181749c076ea0f643387037588043157415"}
Oct 29 23:23:39.301729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.301669    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:39.339708 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.339662    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" podStartSLOduration=2.339647115 podStartE2EDuration="2.339647115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:39.337732787 +0000 UTC m=+630.648977111" watchObservedRunningTime="2026-10-29 23:23:39.339647115 +0000 UTC m=+630.650891441"
Oct 29 23:23:39.374851 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.374807    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" podStartSLOduration=2.374795706 podStartE2EDuration="2.374795706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:39.373394355 +0000 UTC m=+630.684638681" watchObservedRunningTime="2026-10-29 23:23:39.374795706 +0000 UTC m=+630.686040039"
Oct 29 23:23:39.662472 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.662371    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:39.778153 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.778116    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"]
Oct 29 23:23:39.782932 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.782904    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-83198dc0-5bjz2"]
Oct 29 23:23:39.831502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.820777    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:39.911582 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.911550    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"]
Oct 29 23:23:39.911847 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.911821    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" containerID="cri-o://5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795" gracePeriod=30
Oct 29 23:23:39.988501 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:39.988438    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:40.526937 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:40.526896    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:23:40.795149 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:40.795066    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:40.820757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:40.820730    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d8326beb-8a10-47fa-ab2f-8f18a88aa094" path="/var/lib/kubelet/pods/d8326beb-8a10-47fa-ab2f-8f18a88aa094/volumes"
Oct 29 23:23:41.298777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:41.298742    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:41.491539 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:41.483994    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:41.923989 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:41.923378    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:42.347341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:42.347310    5044 patch_prober.go:29] interesting pod/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 29 23:23:42.347528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:42.347364    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:23:43.930860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:43.930823    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:44.086505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:44.080014    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:44.580505 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:44.577092    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:44.734808 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:44.734768    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:45.317822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.316798    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:23:45.325431 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.325352    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:23:45.343049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.343020    5044 generic.go:356] "Generic (PLEG): container finished" podID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerID="5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795" exitCode=0
Oct 29 23:23:45.343212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.343064    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" event={"ID":"6ac0f8fc-f346-4aa8-bf20-02518a801943","Type":"ContainerDied","Data":"5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795"}
Oct 29 23:23:45.343212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.343103    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq" event={"ID":"6ac0f8fc-f346-4aa8-bf20-02518a801943","Type":"ContainerDied","Data":"68f8cc9b27174ee27cbc9f52b1f4aa47113cbc08dd0487ac05277d728711a441"}
Oct 29 23:23:45.343212 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.343124    5044 scope.go:122] "RemoveContainer" containerID="5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795"
Oct 29 23:23:45.343326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.343242    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"
Oct 29 23:23:45.357620 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.357599    5044 scope.go:122] "RemoveContainer" containerID="33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"
Oct 29 23:23:45.428007 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.427982    5044 scope.go:122] "RemoveContainer" containerID="5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795"
Oct 29 23:23:45.428440 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:45.428410    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795\": container with ID starting with 5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795 not found: ID does not exist" containerID="5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795"
Oct 29 23:23:45.428962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.428445    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795"} err="failed to get container status \"5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795\": rpc error: code = NotFound desc = could not find container \"5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795\": container with ID starting with 5d2b0810b47b8b6007e598688158b847dd640c0862be3cd52d9fe919daf73795 not found: ID does not exist"
Oct 29 23:23:45.428962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.428472    5044 scope.go:122] "RemoveContainer" containerID="33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"
Oct 29 23:23:45.428962 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:23:45.428882    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54\": container with ID starting with 33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54 not found: ID does not exist" containerID="33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"
Oct 29 23:23:45.428962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.428916    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54"} err="failed to get container status \"33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54\": rpc error: code = NotFound desc = could not find container \"33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54\": container with ID starting with 33398a0b65342c914770a19323977fa32c381fa9ca2c29b8dd4f78e50a580e54 not found: ID does not exist"
Oct 29 23:23:45.443145 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443124    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443173    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443191    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443234    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443303    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443334    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443369    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443395    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.443524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443454    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert\") pod \"6ac0f8fc-f346-4aa8-bf20-02518a801943\" (UID: \"6ac0f8fc-f346-4aa8-bf20-02518a801943\") "
Oct 29 23:23:45.444029 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.443995    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:23:45.444231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.444208    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:45.444335 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.444238    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:45.444578 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.444514    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:45.444702 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.444564    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:45.445779 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.445756    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:45.446040 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.446021    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "kube-api-access-vrv55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:23:45.447745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.447727    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:23:45.449488 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.449451    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo" pod "6ac0f8fc-f346-4aa8-bf20-02518a801943" (UID: "6ac0f8fc-f346-4aa8-bf20-02518a801943"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545215    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6ac0f8fc-f346-4aa8-bf20-02518a801943-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545243    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrv55\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-kube-api-access-vrv55\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545255    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545263    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545271    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545279    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545286    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545293    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.545298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.545303    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6ac0f8fc-f346-4aa8-bf20-02518a801943-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:23:45.712188 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.712116    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"]
Oct 29 23:23:45.714521 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:45.714491    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-83198dc0-openshift-default-76f9c75f69-vwssq"]
Oct 29 23:23:46.125907 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:46.125870    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:46.820780 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:46.820748    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" path="/var/lib/kubelet/pods/6ac0f8fc-f346-4aa8-bf20-02518a801943/volumes"
Oct 29 23:23:46.995136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:46.995094    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.086493    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"]
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.087258    5044 cpu_manager.go:414] "containerMap: removing container" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy"
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.087278    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy"
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.087305    5044 cpu_manager.go:414] "containerMap: removing container" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy"
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.087314    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy"
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.087463    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy"
Oct 29 23:23:47.091601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.090572    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="6ac0f8fc-f346-4aa8-bf20-02518a801943" containerName="istio-proxy"
Oct 29 23:23:47.095988 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.095964    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.104339 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.103339    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"]
Oct 29 23:23:47.126220 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.126190    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-b2c5f2\""
Oct 29 23:23:47.126585 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.126564    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-b2c5f2-dockercfg-fj7wn\""
Oct 29 23:23:47.140231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.140203    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"]
Oct 29 23:23:47.144814 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.144791    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.161377 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.161346    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.182502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.161557    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxp6b\" (UniqueName: \"kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b\") pod \"payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.194242 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.193789    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"]
Oct 29 23:23:47.203554 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.203524    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:47.275883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.274120    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.275883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.274173    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trpr9\" (UniqueName: \"kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9\") pod \"payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.275883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.274216    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.275883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.274313    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxp6b\" (UniqueName: \"kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b\") pod \"payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.275883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.275701    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.320162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.320131    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxp6b\" (UniqueName: \"kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b\") pod \"payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.379552 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.378235    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.379552 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.378295    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trpr9\" (UniqueName: \"kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9\") pod \"payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.380063 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.380008    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.397749 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.397712    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trpr9\" (UniqueName: \"kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9\") pod \"payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.438078 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.438049    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:47.492503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.481762    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:47.792527 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.787419    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"]
Oct 29 23:23:47.844536 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:47.844509    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"]
Oct 29 23:23:47.848008 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:47.847982    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc91d3b5b_42a4_4fe0_b1ff_973876372fa2.slice/crio-fdb4112c724faff7e1d73d8a484253976b7ab19aa914f7d09ef49d7071907ed5 WatchSource:0}: Error finding container fdb4112c724faff7e1d73d8a484253976b7ab19aa914f7d09ef49d7071907ed5: Status 404 returned error can't find the container with id fdb4112c724faff7e1d73d8a484253976b7ab19aa914f7d09ef49d7071907ed5
Oct 29 23:23:48.082195 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.082057    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:48.387778 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.387637    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" event={"ID":"c91d3b5b-42a4-4fe0-b1ff-973876372fa2","Type":"ContainerStarted","Data":"f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f"}
Oct 29 23:23:48.387778 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.387709    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:48.387778 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.387735    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" event={"ID":"c91d3b5b-42a4-4fe0-b1ff-973876372fa2","Type":"ContainerStarted","Data":"fdb4112c724faff7e1d73d8a484253976b7ab19aa914f7d09ef49d7071907ed5"}
Oct 29 23:23:48.389667 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.389641    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" event={"ID":"4d069ec6-194c-4363-9d0c-82214e977dcf","Type":"ContainerStarted","Data":"36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39"}
Oct 29 23:23:48.389783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.389683    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" event={"ID":"4d069ec6-194c-4363-9d0c-82214e977dcf","Type":"ContainerStarted","Data":"ea14708e682e3531fbbdf2434859410a9e7b4fca6781d3ebfcb5200d1cce0f28"}
Oct 29 23:23:48.389847 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.389792    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:48.425630 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.425534    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" podStartSLOduration=1.425521454 podStartE2EDuration="1.425521454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:48.423959294 +0000 UTC m=+639.735203620" watchObservedRunningTime="2026-10-29 23:23:48.425521454 +0000 UTC m=+639.736765779"
Oct 29 23:23:48.485503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:48.484421    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" podStartSLOduration=1.4844010619999999 podStartE2EDuration="1.484401062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:48.460781668 +0000 UTC m=+639.772025993" watchObservedRunningTime="2026-10-29 23:23:48.484401062 +0000 UTC m=+639.795645381"
Oct 29 23:23:49.448453 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:49.448415    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:49.623263 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:49.623222    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:50.083628 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:50.083590    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:50.293502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:50.293124    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:50.318455 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:50.318420    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:23:50.319949 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:50.319925    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:23:50.453014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:50.452543    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:51.492538 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.492496    5044 generic.go:356] "Generic (PLEG): container finished" podID="9d911b59-c9fc-43f4-a254-816ff9818469" containerID="74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1" exitCode=0
Oct 29 23:23:51.493223 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.492547    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" event={"ID":"9d911b59-c9fc-43f4-a254-816ff9818469","Type":"ContainerDied","Data":"74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"}
Oct 29 23:23:51.493982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.493953    5044 scope.go:122] "RemoveContainer" containerID="74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"
Oct 29 23:23:51.495944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.495914    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:51.496137 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.496121    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:51.496261 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.496248    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:51.594076 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.594034    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"]
Oct 29 23:23:51.612082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.612027    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.614002 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.613971    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"]
Oct 29 23:23:51.630506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.626776    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"simulator-w3-105882-kserve-self-signed-certs\""
Oct 29 23:23:51.630506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.629591    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"kube-root-ca.crt\""
Oct 29 23:23:51.630506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.629705    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"openshift-service-ca.crt\""
Oct 29 23:23:51.645522 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.641779    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-105882\"/\"default-dockercfg-dbxcz\""
Oct 29 23:23:51.652903 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.648792    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:51.662200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.661535    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx6kl\" (UniqueName: \"kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.662200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.661666    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.662200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.661754    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.662200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.661797    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.662200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.661944    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.689502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.675681    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778110    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx6kl\" (UniqueName: \"kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778198    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778240    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778284    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778342    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778393    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.784553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.778887    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.794509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.785348    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.812290 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.811807    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.817844 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.817810    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.819404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.819343    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.821263 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.821218    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx6kl\" (UniqueName: \"kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl\") pod \"simulator-w3-105882-kserve-6d85c7d848-qg6jr\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") " pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:51.929495 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:51.929079    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:52.315851 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.308134    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"]
Oct 29 23:23:52.522192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.521507    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" event={"ID":"c826d510-6313-4ad6-ba3b-9aa126d604e0","Type":"ContainerStarted","Data":"082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953"}
Oct 29 23:23:52.522192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.521575    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" event={"ID":"c826d510-6313-4ad6-ba3b-9aa126d604e0","Type":"ContainerStarted","Data":"b6c192a8f6356bf70c168c58d069634bfde541a2906848dcfaec4a62c4b94592"}
Oct 29 23:23:52.524055 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.524026    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" event={"ID":"9d911b59-c9fc-43f4-a254-816ff9818469","Type":"ContainerStarted","Data":"7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416"}
Oct 29 23:23:52.593555 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.584345    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" podStartSLOduration=1.584324161 podStartE2EDuration="1.584324161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:52.581900521 +0000 UTC m=+643.893144846" watchObservedRunningTime="2026-10-29 23:23:52.584324161 +0000 UTC m=+643.895568484"
Oct 29 23:23:52.628244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.627727    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:52.628244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.627887    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 29 23:23:52.628244 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.627929    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 29 23:23:52.929761 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:52.929685    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:23:53.217539 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.217429    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"]
Oct 29 23:23:53.222491 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.222128    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.240528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.240301    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"]
Oct 29 23:23:53.248657 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.248627    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"kube-root-ca.crt\""
Oct 29 23:23:53.248657 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.248627    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"openshift-service-ca.crt\""
Oct 29 23:23:53.288995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.288670    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"simulator-w4-bed4a2-kserve-self-signed-certs\""
Oct 29 23:23:53.288995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.288949    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-bed4a2\"/\"default-dockercfg-ch2fz\""
Oct 29 23:23:53.318788 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.318750    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:53.330571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.330370    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jjhh\" (UniqueName: \"kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.330571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.330422    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.330571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.330449    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.330571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.330515    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.330860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.330640    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.330860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.330678    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.432729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.432149    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.433011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.432988    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.433342 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.433315    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jjhh\" (UniqueName: \"kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.433430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.433402    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.433511 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.433438    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.433574 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.433553    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.434211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.433906    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.434211 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.432687    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.434646 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.434625    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.438137 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.437845    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.439612 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.439563    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.453397 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.453346    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jjhh\" (UniqueName: \"kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh\") pod \"simulator-w4-bed4a2-kserve-7bb7689c65-cx894\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") " pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.535353 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.535321    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:53.627624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.627582    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 29 23:23:53.627814 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.627638    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 29 23:23:53.910530 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:53.910417    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"]
Oct 29 23:23:53.917020 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:23:53.916993    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a5e22f2_7e1a_4423_ba11_44ca246b6fab.slice/crio-f9108b5d9ba9230b302dddc6a0ff3f5355c48cf3e2a530d58d6844796969cb86 WatchSource:0}: Error finding container f9108b5d9ba9230b302dddc6a0ff3f5355c48cf3e2a530d58d6844796969cb86: Status 404 returned error can't find the container with id f9108b5d9ba9230b302dddc6a0ff3f5355c48cf3e2a530d58d6844796969cb86
Oct 29 23:23:54.214614 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.214521    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:54.412513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.412430    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:54.541499 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.541015    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894" event={"ID":"5a5e22f2-7e1a-4423-ba11-44ca246b6fab","Type":"ContainerStarted","Data":"03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4"}
Oct 29 23:23:54.541499 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.541059    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894" event={"ID":"5a5e22f2-7e1a-4423-ba11-44ca246b6fab","Type":"ContainerStarted","Data":"f9108b5d9ba9230b302dddc6a0ff3f5355c48cf3e2a530d58d6844796969cb86"}
Oct 29 23:23:54.627518 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.627469    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 29 23:23:54.627665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.627534    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 29 23:23:54.775506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:54.771060    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:55.352763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:55.352727    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:55.512266 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:55.512222    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:55.536215 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:55.536177    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:23:55.627940 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:55.627909    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 29 23:23:55.628410 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:55.627961    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 29 23:23:56.242944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.242344    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:56.588517 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.588145    5044 generic.go:356] "Generic (PLEG): container finished" podID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerID="5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac" exitCode=0
Oct 29 23:23:56.589544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.589019    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" event={"ID":"36863338-77db-48dd-a2b0-1fe43d26b7dc","Type":"ContainerDied","Data":"5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"}
Oct 29 23:23:56.589544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.589330    5044 scope.go:122] "RemoveContainer" containerID="5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"
Oct 29 23:23:56.590604 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.590576    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:56.590662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.590647    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:56.590706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.590678    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:23:56.627097 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.627066    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 29 23:23:56.627242 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.627118    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 29 23:23:56.691004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:56.690950    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894" podStartSLOduration=3.690913789 podStartE2EDuration="3.690913789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:23:54.600677096 +0000 UTC m=+645.911921424" watchObservedRunningTime="2026-10-29 23:23:56.690913789 +0000 UTC m=+648.002158115"
Oct 29 23:23:57.614786 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:57.614744    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" event={"ID":"36863338-77db-48dd-a2b0-1fe43d26b7dc","Type":"ContainerStarted","Data":"4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2"}
Oct 29 23:23:57.627030 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:57.626994    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 29 23:23:57.627207 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:57.627059    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 29 23:23:58.192504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.191608    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:58.230158 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.230114    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:23:58.231776 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.231738    5044 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 29 23:23:58.231911 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.231816    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 29 23:23:58.305786 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.305747    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:58.631938 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.631905    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:58.632368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.632351    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:58.632943 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:58.632923    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:23:59.217804 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:59.217760    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:23:59.229791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:59.229767    5044 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 29 23:23:59.229891 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:59.229818    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 29 23:23:59.403597 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:59.403568    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:23:59.403883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:59.403864    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:23:59.948320 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:23:59.948285    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:00.198046 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.197929    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:00.229807 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.229777    5044 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 29 23:24:00.230206 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.229843    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 29 23:24:00.544102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.544065    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:00.635340 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.635305    5044 generic.go:356] "Generic (PLEG): container finished" podID="d27d7164-13e0-449d-b22c-2043b844b88a" containerID="0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de" exitCode=0
Oct 29 23:24:00.635555 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.635367    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" event={"ID":"d27d7164-13e0-449d-b22c-2043b844b88a","Type":"ContainerDied","Data":"0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"}
Oct 29 23:24:00.635803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.635782    5044 scope.go:122] "RemoveContainer" containerID="0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"
Oct 29 23:24:00.636952 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.636925    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:24:00.637046 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.636990    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:24:00.637046 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.637021    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:24:00.708096 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.708061    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:00.848276 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:00.848163    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:01.230266 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.230236    5044 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 29 23:24:01.230745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.230298    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 29 23:24:01.646703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.646620    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" event={"ID":"d27d7164-13e0-449d-b22c-2043b844b88a","Type":"ContainerStarted","Data":"5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5"}
Oct 29 23:24:01.930586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.930467    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:24:01.942631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.942605    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:24:01.969501 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.966959    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:24:01.974502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.973597    5044 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 29 23:24:01.974502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:01.973659    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 29 23:24:02.183565 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.183286    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:02.230064 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.230029    5044 patch_prober.go:29] interesting pod/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 29 23:24:02.230234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.230077    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 29 23:24:02.324965 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.324923    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:02.718958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.718922    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:24:02.970557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.967897    5044 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 29 23:24:02.970557 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:02.967976    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 29 23:24:03.230145 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.230108    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:24:03.233942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.233916    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:24:03.234897 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.234878    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:24:03.536044 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.535963    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:24:03.549057 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.549026    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:24:03.696955 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.696923    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:24:03.976566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.967899    5044 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 29 23:24:03.976566 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:03.967963    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 29 23:24:04.001326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:04.001286    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:04.966504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:04.965890    5044 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 29 23:24:04.966504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:04.965995    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 29 23:24:05.414385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.414349    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"]
Oct 29 23:24:05.418780 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.418754    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.437763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.437733    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"]
Oct 29 23:24:05.445667 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.445644    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-bacddc\"/\"kube-root-ca.crt\""
Oct 29 23:24:05.446048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.446020    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bacddc\"/\"default-dockercfg-x692s\""
Oct 29 23:24:05.446048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.446012    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bacddc\"/\"simulator-w2-bacddc-kserve-self-signed-certs\""
Oct 29 23:24:05.446183 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.445877    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-bacddc\"/\"openshift-service-ca.crt\""
Oct 29 23:24:05.518152 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.518123    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:05.553393 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.553361    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.553598 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.553406    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.553598 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.553430    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhhcq\" (UniqueName: \"kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.553598 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.553567    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.553709 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.553639    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.553743 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.553695    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.654894 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.654855    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.654894 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.654896    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.654977    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.655015    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.655060    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhhcq\" (UniqueName: \"kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.655103    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.655465    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.655498    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.655665 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.655626    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.657278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.657254    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.657571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.657551    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.704561 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.694934    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhhcq\" (UniqueName: \"kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq\") pod \"simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") " pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.713616 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.712666    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:05.735416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.735390    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:05.986500 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.985908    5044 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 29 23:24:05.986500 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:05.985969    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 29 23:24:06.048546 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:06.048517    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"]
Oct 29 23:24:06.049979 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:24:06.049954    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8ccf4b9_02e1_472a_aa1d_bc9a608d55c0.slice/crio-4154468084dbd6833b97a8bcb9542e2b460f8b56673752caa5110f72c2e7b4f7 WatchSource:0}: Error finding container 4154468084dbd6833b97a8bcb9542e2b460f8b56673752caa5110f72c2e7b4f7: Status 404 returned error can't find the container with id 4154468084dbd6833b97a8bcb9542e2b460f8b56673752caa5110f72c2e7b4f7
Oct 29 23:24:06.725546 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:06.725504    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" event={"ID":"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0","Type":"ContainerStarted","Data":"b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618"}
Oct 29 23:24:06.725715 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:06.725558    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" event={"ID":"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0","Type":"ContainerStarted","Data":"4154468084dbd6833b97a8bcb9542e2b460f8b56673752caa5110f72c2e7b4f7"}
Oct 29 23:24:06.735815 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:06.735789    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:06.766230 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:06.766166    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" podStartSLOduration=1.766149177 podStartE2EDuration="1.766149177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:06.763340032 +0000 UTC m=+658.074584354" watchObservedRunningTime="2026-10-29 23:24:06.766149177 +0000 UTC m=+658.077393504"
Oct 29 23:24:07.006384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:07.006285    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:24:07.008166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:07.008145    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:24:07.481979 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:07.481939    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:09.379611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:09.379567    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:09.659314 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:09.659214    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:10.254721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:10.254682    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:10.403654 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:10.403615    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:10.526438 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:24:10.526354    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:24:10.558751 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:10.558714    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:11.134047 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:11.134012    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:11.658232 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:11.658201    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:12.882938 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:12.882893    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:14.712072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:14.712022    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:15.736504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:15.736453    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:15.749131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:15.749100    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:15.789086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:15.789050    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:24:16.491979 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:16.491944    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:18.314210 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:18.314167    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:20.071352 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:20.071257    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:21.298611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.298575    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"]
Oct 29 23:24:21.308763 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.308736    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.323079 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.322976    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"]
Oct 29 23:24:21.331324 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.331288    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"kube-root-ca.crt\""
Oct 29 23:24:21.331324 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.331306    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"openshift-service-ca.crt\""
Oct 29 23:24:21.331519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.331505    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"simulator-w1-b2c5f2-kserve-self-signed-certs\""
Oct 29 23:24:21.333399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.333377    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-b2c5f2\"/\"default-dockercfg-b2kl2\""
Oct 29 23:24:21.413973 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.413924    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:21.443195 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.443166    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.443374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.443228    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.443374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.443311    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.443527 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.443377    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.443527 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.443421    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.443612 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.443530    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr5jn\" (UniqueName: \"kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.544656 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.544622    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.544656 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.544658    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.544918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.544691    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.544918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.544723    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.544918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.544770    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr5jn\" (UniqueName: \"kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.544918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.544837    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.545512 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.545127    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.545512 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.545144    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.545512 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.545193    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.547465 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.547442    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.547796 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.547777    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.564062 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.563997    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr5jn\" (UniqueName: \"kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn\") pod \"simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") " pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.624749 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.624714    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:21.801778 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.801742    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:21.933880 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:21.933853    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"]
Oct 29 23:24:21.934747 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:24:21.934719    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a93de89_45c1_4bc1_9f61_5486d25dab16.slice/crio-0a95c4a902476ba49011217b0f3615d0dbd431c8fab4581ca48cbf0a9e741d79 WatchSource:0}: Error finding container 0a95c4a902476ba49011217b0f3615d0dbd431c8fab4581ca48cbf0a9e741d79: Status 404 returned error can't find the container with id 0a95c4a902476ba49011217b0f3615d0dbd431c8fab4581ca48cbf0a9e741d79
Oct 29 23:24:22.821238 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:22.821207    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" event={"ID":"0a93de89-45c1-4bc1-9f61-5486d25dab16","Type":"ContainerStarted","Data":"b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576"}
Oct 29 23:24:22.821238 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:22.821243    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" event={"ID":"0a93de89-45c1-4bc1-9f61-5486d25dab16","Type":"ContainerStarted","Data":"0a95c4a902476ba49011217b0f3615d0dbd431c8fab4581ca48cbf0a9e741d79"}
Oct 29 23:24:22.859416 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:22.859368    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" podStartSLOduration=1.859354496 podStartE2EDuration="1.859354496s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:22.858150836 +0000 UTC m=+674.169395161" watchObservedRunningTime="2026-10-29 23:24:22.859354496 +0000 UTC m=+674.170598821"
Oct 29 23:24:23.579430 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:23.579393    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:23.625189 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:23.625149    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:25.299004 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:25.297039    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:25.589340 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:25.589256    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:27.101073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:27.101031    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:28.795023 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:28.794962    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:28.928866 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:28.928815    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:30.495855 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:30.495764    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:31.625462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:31.625420    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:31.638137 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:31.638109    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:31.885170 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:31.885083    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:24:32.376501 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:32.376440    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:34.170223 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.170188    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:34.872250 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.872217    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"]
Oct 29 23:24:34.881107 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.881081    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:34.896125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.896095    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"]
Oct 29 23:24:34.904228 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.904198    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-bacddc\"/\"premium-w2-bacddc-kserve-self-signed-certs\""
Oct 29 23:24:34.982360 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.982332    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:34.989616 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.989588    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:34.989722 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.989635    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:34.989722 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.989653    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hk9\" (UniqueName: \"kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:34.989791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.989772    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:34.989828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.989807    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:34.989862 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:34.989841    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.090846 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.090811    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.090864    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.090893    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hk9\" (UniqueName: \"kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.090948    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091048 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.090997    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091250 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.091168    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091337 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.091316    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091459 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.091441    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.091524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.091502    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.093435 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.093409    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.093645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.093626    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.114555 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.114531    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hk9\" (UniqueName: \"kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9\") pod \"premium-w2-bacddc-kserve-85cff9dc89-2t6vp\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") " pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.199017 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.198937    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:35.494425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.494398    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"]
Oct 29 23:24:35.495937 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:24:35.495908    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1056ff58_0daa_4e25_a809_15d4d3cfa15b.slice/crio-bee30bec3140d21ef96c00b9a9575ae5c64be0b89d28bc08956b8764c9aaf217 WatchSource:0}: Error finding container bee30bec3140d21ef96c00b9a9575ae5c64be0b89d28bc08956b8764c9aaf217: Status 404 returned error can't find the container with id bee30bec3140d21ef96c00b9a9575ae5c64be0b89d28bc08956b8764c9aaf217
Oct 29 23:24:35.885655 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.885557    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:35.903747 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.903698    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp" event={"ID":"1056ff58-0daa-4e25-a809-15d4d3cfa15b","Type":"ContainerStarted","Data":"b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c"}
Oct 29 23:24:35.903928 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.903757    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp" event={"ID":"1056ff58-0daa-4e25-a809-15d4d3cfa15b","Type":"ContainerStarted","Data":"bee30bec3140d21ef96c00b9a9575ae5c64be0b89d28bc08956b8764c9aaf217"}
Oct 29 23:24:35.941386 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:35.941339    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp" podStartSLOduration=1.9413269930000001 podStartE2EDuration="1.941326993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:35.940508336 +0000 UTC m=+687.251752654" watchObservedRunningTime="2026-10-29 23:24:35.941326993 +0000 UTC m=+687.252571318"
Oct 29 23:24:36.199608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:36.199522    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:37.700918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:37.700878    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:39.491302 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:39.491137    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:40.526604 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:24:40.526571    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:24:41.189773 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:41.189727    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:43.083709 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:43.083674    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:44.952997 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:44.952946    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:45.199503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:45.199445    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:45.212651 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:45.212582    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:45.978633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:45.978604    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:24:46.679472 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:46.679437    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:48.147252 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:48.147211    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:48.501404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:48.501374    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:50.515179 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:50.515144    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:52.287165 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:52.287108    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:53.997357 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:53.997325    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:54.576246 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.576186    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:54.709899 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.709863    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:54.771579 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.771545    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"]
Oct 29 23:24:54.775338 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.775315    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:54.791302 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.791269    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"]
Oct 29 23:24:54.799921 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.799893    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"openshift-service-ca.crt\""
Oct 29 23:24:54.800043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.799906    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"kube-root-ca.crt\""
Oct 29 23:24:54.800043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.799930    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"premium-w0-b0153c-kserve-self-signed-certs\""
Oct 29 23:24:54.800043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.799936    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-b0153c\"/\"default-dockercfg-bjh5f\""
Oct 29 23:24:54.862056 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.861968    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:54.899809 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.899783    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:54.899951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.899849    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8d86\" (UniqueName: \"kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:54.900016 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.900000    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:54.900074 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.900050    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:54.900298 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.900281    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:54.900349 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:54.900308    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.001462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001431    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.001954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001522    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8d86\" (UniqueName: \"kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.001954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001547    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.001954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001576    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.001954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001627    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.001954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001644    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.002153 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.001957    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.002153 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.002008    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.002153 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.002082    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.003868 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.003840    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.004170 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.004153    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.021551 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.021529    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8d86\" (UniqueName: \"kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86\") pod \"premium-w0-b0153c-kserve-b78dfdbd8-m4qpw\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") " pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.088372 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.088345    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:55.380359 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.380331    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"]
Oct 29 23:24:55.381794 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:24:55.381761    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60065167_1bee_4ee5_9a43_7fb8666fc1d9.slice/crio-9035af7b6291f6f407e284d3a8319a498c857fcd4c4ecf3a16664e74b6e0b5fe WatchSource:0}: Error finding container 9035af7b6291f6f407e284d3a8319a498c857fcd4c4ecf3a16664e74b6e0b5fe: Status 404 returned error can't find the container with id 9035af7b6291f6f407e284d3a8319a498c857fcd4c4ecf3a16664e74b6e0b5fe
Oct 29 23:24:55.780235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:55.780198    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:56.052061 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:56.051975    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" event={"ID":"60065167-1bee-4ee5-9a43-7fb8666fc1d9","Type":"ContainerStarted","Data":"d6f71cee04103eada1e4ac52f27688d4bd3601b7892488deb350994a88e75b3c"}
Oct 29 23:24:56.052061 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:56.052021    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" event={"ID":"60065167-1bee-4ee5-9a43-7fb8666fc1d9","Type":"ContainerStarted","Data":"9035af7b6291f6f407e284d3a8319a498c857fcd4c4ecf3a16664e74b6e0b5fe"}
Oct 29 23:24:56.088519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:56.088464    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:24:56.090663 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:56.090624    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" podStartSLOduration=2.090612899 podStartE2EDuration="2.090612899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:24:56.089443352 +0000 UTC m=+707.400687676" watchObservedRunningTime="2026-10-29 23:24:56.090612899 +0000 UTC m=+707.401857243"
Oct 29 23:24:57.579282 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:57.579233    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:59.318504 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:59.318441    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:24:59.485998 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:24:59.485951    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:01.186675 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:01.186580    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:02.893603 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:02.893563    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:04.591045 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:04.590988    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:05.089360 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:05.089325    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:25:05.105892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:05.105864    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:25:05.117446 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:05.117419    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:25:06.385722 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:06.385685    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:08.192842 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:08.192808    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:10.220289 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:10.220242    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:10.526822 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:25:10.526787    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:25:12.062752 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:12.062721    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:13.208060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:13.208021    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:13.956902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:13.956861    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:15.709404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:15.709365    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:17.504053 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:17.504022    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:19.275606 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:19.275525    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:21.078330 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:21.078291    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:22.935775 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:22.935739    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:23.578063 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.578026    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"]
Oct 29 23:25:23.581789 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.581770    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.596287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.596266    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:25:23.598790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.598764    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"]
Oct 29 23:25:23.606939 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.606916    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:25:23.607961 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.607942    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:25:23.608054 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.607995    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:25:23.615546 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.615523    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkxgg\" (UniqueName: \"kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.615636 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.615582    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.615832 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.615807    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.716828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.716797    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.716988 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.716912    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.716988 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.716952    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkxgg\" (UniqueName: \"kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.717606 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.717579    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.719179 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.719162    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.736056 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.736033    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkxgg\" (UniqueName: \"kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg\") pod \"maas-api-revoke-sub-647cb05f-mkg57\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:23.895413 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:23.895348    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:24.193231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:24.193189    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"]
Oct 29 23:25:24.196716 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:25:24.196685    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bb939e7_9bdb_4739_8a30_9096e511a7aa.slice/crio-4b158c35bee28f31bac008214ad80beb77aaf1ca12dea674fda89452ec89ad8e WatchSource:0}: Error finding container 4b158c35bee28f31bac008214ad80beb77aaf1ca12dea674fda89452ec89ad8e: Status 404 returned error can't find the container with id 4b158c35bee28f31bac008214ad80beb77aaf1ca12dea674fda89452ec89ad8e
Oct 29 23:25:24.214253 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:24.214228    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57" event={"ID":"7bb939e7-9bdb-4739-8a30-9096e511a7aa","Type":"ContainerStarted","Data":"4b158c35bee28f31bac008214ad80beb77aaf1ca12dea674fda89452ec89ad8e"}
Oct 29 23:25:24.752564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:24.752531    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:25.222450 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:25.222417    5044 generic.go:356] "Generic (PLEG): container finished" podID="7bb939e7-9bdb-4739-8a30-9096e511a7aa" containerID="ada9e60ee916a47fd307d59cc49ab4ee596b467ccdbdf21336ad6d6faacd21df" exitCode=0
Oct 29 23:25:25.222838 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:25.222505    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57" event={"ID":"7bb939e7-9bdb-4739-8a30-9096e511a7aa","Type":"ContainerDied","Data":"ada9e60ee916a47fd307d59cc49ab4ee596b467ccdbdf21336ad6d6faacd21df"}
Oct 29 23:25:26.376644 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.376620    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:26.446702 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.446676    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca\") pod \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") "
Oct 29 23:25:26.446881 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.446743    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg\" (UniqueName: \"kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg\") pod \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") "
Oct 29 23:25:26.446965 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.446890    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca\") pod \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\" (UID: \"7bb939e7-9bdb-4739-8a30-9096e511a7aa\") "
Oct 29 23:25:26.447135 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.447102    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca" pod "7bb939e7-9bdb-4739-8a30-9096e511a7aa" (UID: "7bb939e7-9bdb-4739-8a30-9096e511a7aa"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:25:26.447449 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.447420    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:26.448953 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.448924    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg" pod "7bb939e7-9bdb-4739-8a30-9096e511a7aa" (UID: "7bb939e7-9bdb-4739-8a30-9096e511a7aa"). InnerVolumeSpecName "kube-api-access-xkxgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:25:26.449069 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.448968    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca" pod "7bb939e7-9bdb-4739-8a30-9096e511a7aa" (UID: "7bb939e7-9bdb-4739-8a30-9096e511a7aa"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:25:26.513633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.513537    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:26.548246 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.548218    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkxgg\" (UniqueName: \"kubernetes.io/projected/7bb939e7-9bdb-4739-8a30-9096e511a7aa-kube-api-access-xkxgg\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:26.548246 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:26.548244    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/7bb939e7-9bdb-4739-8a30-9096e511a7aa-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:27.234292 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:27.234263    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57"
Oct 29 23:25:27.234468 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:27.234256    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-647cb05f-mkg57" event={"ID":"7bb939e7-9bdb-4739-8a30-9096e511a7aa","Type":"ContainerDied","Data":"4b158c35bee28f31bac008214ad80beb77aaf1ca12dea674fda89452ec89ad8e"}
Oct 29 23:25:27.234468 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:27.234379    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b158c35bee28f31bac008214ad80beb77aaf1ca12dea674fda89452ec89ad8e"
Oct 29 23:25:28.292256 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:28.292211    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:29.303855 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.303823    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"]
Oct 29 23:25:29.304306 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.304293    5044 cpu_manager.go:414] "containerMap: removing container" podUID="7bb939e7-9bdb-4739-8a30-9096e511a7aa" containerName="revoke-keys"
Oct 29 23:25:29.304351 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.304306    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bb939e7-9bdb-4739-8a30-9096e511a7aa" containerName="revoke-keys"
Oct 29 23:25:29.304424 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.304415    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bb939e7-9bdb-4739-8a30-9096e511a7aa" containerName="revoke-keys"
Oct 29 23:25:29.307979 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.307959    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.325166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.325146    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"]
Oct 29 23:25:29.333626 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.333607    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:25:29.333732 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.333710    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:25:29.333814 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.333646    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:25:29.333814 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.333780    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:25:29.374599 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.374573    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7plb\" (UniqueName: \"kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.374728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.374627    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.374782 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.374758    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.476274 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.476244    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7plb\" (UniqueName: \"kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.476465 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.476285    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.476465 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.476358    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.477082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.477063    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.478641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.478622    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.494452 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.494430    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7plb\" (UniqueName: \"kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb\") pod \"maas-api-revoke-sub-ceb89723-hnj8s\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.621047 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.620981    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:29.917610 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:29.917580    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"]
Oct 29 23:25:29.918197 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:25:29.918166    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27ac592_6670_4185_802f_f71009255bbd.slice/crio-29722e781252c942b52d2d4a6154c2f32837916b4ba4df0b39b93c814a6c33dc WatchSource:0}: Error finding container 29722e781252c942b52d2d4a6154c2f32837916b4ba4df0b39b93c814a6c33dc: Status 404 returned error can't find the container with id 29722e781252c942b52d2d4a6154c2f32837916b4ba4df0b39b93c814a6c33dc
Oct 29 23:25:30.163976 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:30.163941    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:30.256331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:30.256294    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s" event={"ID":"e27ac592-6670-4185-802f-f71009255bbd","Type":"ContainerStarted","Data":"6236a736276babc131d4e9f65ff09276fbe03596241ade234abcba84f392da6b"}
Oct 29 23:25:30.256541 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:30.256349    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s" event={"ID":"e27ac592-6670-4185-802f-f71009255bbd","Type":"ContainerStarted","Data":"29722e781252c942b52d2d4a6154c2f32837916b4ba4df0b39b93c814a6c33dc"}
Oct 29 23:25:30.295849 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:30.295798    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s" podStartSLOduration=1.295783812 podStartE2EDuration="1.295783812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:30.293375582 +0000 UTC m=+741.604620035" watchObservedRunningTime="2026-10-29 23:25:30.295783812 +0000 UTC m=+741.607028139"
Oct 29 23:25:31.264084 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:31.264052    5044 generic.go:356] "Generic (PLEG): container finished" podID="e27ac592-6670-4185-802f-f71009255bbd" containerID="6236a736276babc131d4e9f65ff09276fbe03596241ade234abcba84f392da6b" exitCode=0
Oct 29 23:25:31.264503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:31.264113    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s" event={"ID":"e27ac592-6670-4185-802f-f71009255bbd","Type":"ContainerDied","Data":"6236a736276babc131d4e9f65ff09276fbe03596241ade234abcba84f392da6b"}
Oct 29 23:25:31.874942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:31.874907    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:32.414579 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.414551    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:32.510787 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.510758    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca\") pod \"e27ac592-6670-4185-802f-f71009255bbd\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") "
Oct 29 23:25:32.510951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.510809    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb\" (UniqueName: \"kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb\") pod \"e27ac592-6670-4185-802f-f71009255bbd\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") "
Oct 29 23:25:32.510951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.510890    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca\") pod \"e27ac592-6670-4185-802f-f71009255bbd\" (UID: \"e27ac592-6670-4185-802f-f71009255bbd\") "
Oct 29 23:25:32.511294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.511261    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca" pod "e27ac592-6670-4185-802f-f71009255bbd" (UID: "e27ac592-6670-4185-802f-f71009255bbd"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:25:32.512918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.512895    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca" pod "e27ac592-6670-4185-802f-f71009255bbd" (UID: "e27ac592-6670-4185-802f-f71009255bbd"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:25:32.513042 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.513023    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb" pod "e27ac592-6670-4185-802f-f71009255bbd" (UID: "e27ac592-6670-4185-802f-f71009255bbd"). InnerVolumeSpecName "kube-api-access-j7plb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:25:32.611926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.611885    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e27ac592-6670-4185-802f-f71009255bbd-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:32.611926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.611924    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e27ac592-6670-4185-802f-f71009255bbd-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:32.611926 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:32.611933    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7plb\" (UniqueName: \"kubernetes.io/projected/e27ac592-6670-4185-802f-f71009255bbd-kube-api-access-j7plb\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:33.277099 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:33.277068    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s"
Oct 29 23:25:33.277295 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:33.277112    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ceb89723-hnj8s" event={"ID":"e27ac592-6670-4185-802f-f71009255bbd","Type":"ContainerDied","Data":"29722e781252c942b52d2d4a6154c2f32837916b4ba4df0b39b93c814a6c33dc"}
Oct 29 23:25:33.277295 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:33.277165    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29722e781252c942b52d2d4a6154c2f32837916b4ba4df0b39b93c814a6c33dc"
Oct 29 23:25:33.556080 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:33.555991    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:35.279181 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:35.279147    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:37.016529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:37.014273    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:38.228043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.228009    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"]
Oct 29 23:25:38.228531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.228516    5044 cpu_manager.go:414] "containerMap: removing container" podUID="e27ac592-6670-4185-802f-f71009255bbd" containerName="revoke-keys"
Oct 29 23:25:38.228531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.228531    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e27ac592-6670-4185-802f-f71009255bbd" containerName="revoke-keys"
Oct 29 23:25:38.228637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.228628    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="e27ac592-6670-4185-802f-f71009255bbd" containerName="revoke-keys"
Oct 29 23:25:38.232194 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.232177    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.262772 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.262744    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:25:38.262953 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.262745    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:25:38.262953 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.262785    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:25:38.262953 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.262855    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:25:38.265778 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.265755    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"]
Oct 29 23:25:38.377803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.377768    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.377987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.377817    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k9vk\" (UniqueName: \"kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.377987 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.377898    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.479634 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.479546    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.479634 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.479591    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k9vk\" (UniqueName: \"kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.479634 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.479630    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.480261 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.480237    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.481995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.481971    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.498384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.498359    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k9vk\" (UniqueName: \"kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk\") pod \"maas-api-revoke-sub-5631b502-4b8jq\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.545657 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.545627    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:38.828698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.828619    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:38.845178 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:38.845155    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"]
Oct 29 23:25:38.846625 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:25:38.846596    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf19592c0_e059_4336_8b5b_934b6c55fbc8.slice/crio-224e3be3c05a8d18a8e1c0f0244e562ed36ffb6659aef3010e3e52368b8321db WatchSource:0}: Error finding container 224e3be3c05a8d18a8e1c0f0244e562ed36ffb6659aef3010e3e52368b8321db: Status 404 returned error can't find the container with id 224e3be3c05a8d18a8e1c0f0244e562ed36ffb6659aef3010e3e52368b8321db
Oct 29 23:25:39.313503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:39.313434    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq" event={"ID":"f19592c0-e059-4336-8b5b-934b6c55fbc8","Type":"ContainerStarted","Data":"81ef111a55b64445610754cb29211de0265a8652b34ebc1a59d66efa85385993"}
Oct 29 23:25:39.313503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:39.313511    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq" event={"ID":"f19592c0-e059-4336-8b5b-934b6c55fbc8","Type":"ContainerStarted","Data":"224e3be3c05a8d18a8e1c0f0244e562ed36ffb6659aef3010e3e52368b8321db"}
Oct 29 23:25:39.354401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:39.354348    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq" podStartSLOduration=1.354335714 podStartE2EDuration="1.354335714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:39.3516789 +0000 UTC m=+750.662923225" watchObservedRunningTime="2026-10-29 23:25:39.354335714 +0000 UTC m=+750.665580038"
Oct 29 23:25:40.320265 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.320232    5044 generic.go:356] "Generic (PLEG): container finished" podID="f19592c0-e059-4336-8b5b-934b6c55fbc8" containerID="81ef111a55b64445610754cb29211de0265a8652b34ebc1a59d66efa85385993" exitCode=0
Oct 29 23:25:40.320687 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.320310    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq" event={"ID":"f19592c0-e059-4336-8b5b-934b6c55fbc8","Type":"ContainerDied","Data":"81ef111a55b64445610754cb29211de0265a8652b34ebc1a59d66efa85385993"}
Oct 29 23:25:40.527462 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:25:40.527425    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:25:40.589944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.589841    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:40.811055 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.811022    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"]
Oct 29 23:25:40.815854 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.815828    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.845890 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.845828    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-105882-openshift-default-dockercfg-d9v6v\""
Oct 29 23:25:40.849123 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.849094    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"]
Oct 29 23:25:40.909572 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909532    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909572 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909571    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909817 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909598    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909817 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909716    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909817 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909798    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909938 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909841    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909976 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909939    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2s9ql\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.909976 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.909964    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:40.910059 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:40.910032    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.011737 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.011702    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.011737 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.011740    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.011995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.011767    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.011995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.011875    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.011995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.011923    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.011995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.011991    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2s9ql\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012214 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012008    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012214 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012061    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012214 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012130    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012214 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012146    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012214 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012199    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012464 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012297    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012464 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012439    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.012629 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.012608    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.014255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.014235    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.014525 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.014508    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.030569 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.030537    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2s9ql\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.030688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.030545    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token\") pod \"e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") " pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.130679 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.130591    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:41.441653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.441624    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"]
Oct 29 23:25:41.443244 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:25:41.443217    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5d42d2_e0ae_4be1_8a14_1c3a86fe2396.slice/crio-444411200d877206f8791d01f66396013c4d6885c3d64971b36b523d756fd4ac WatchSource:0}: Error finding container 444411200d877206f8791d01f66396013c4d6885c3d64971b36b523d756fd4ac: Status 404 returned error can't find the container with id 444411200d877206f8791d01f66396013c4d6885c3d64971b36b523d756fd4ac
Oct 29 23:25:41.445683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.445652    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:25:41.445788 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.445716    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:25:41.445788 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.445745    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:25:41.450577 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.450558    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:41.618173 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.618135    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca\") pod \"f19592c0-e059-4336-8b5b-934b6c55fbc8\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") "
Oct 29 23:25:41.618365 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.618231    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk\" (UniqueName: \"kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk\") pod \"f19592c0-e059-4336-8b5b-934b6c55fbc8\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") "
Oct 29 23:25:41.618422 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.618376    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca\") pod \"f19592c0-e059-4336-8b5b-934b6c55fbc8\" (UID: \"f19592c0-e059-4336-8b5b-934b6c55fbc8\") "
Oct 29 23:25:41.618805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.618776    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca" pod "f19592c0-e059-4336-8b5b-934b6c55fbc8" (UID: "f19592c0-e059-4336-8b5b-934b6c55fbc8"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:25:41.619044 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.619020    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:41.620954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.620929    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca" pod "f19592c0-e059-4336-8b5b-934b6c55fbc8" (UID: "f19592c0-e059-4336-8b5b-934b6c55fbc8"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:25:41.621094 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.621080    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk" pod "f19592c0-e059-4336-8b5b-934b6c55fbc8" (UID: "f19592c0-e059-4336-8b5b-934b6c55fbc8"). InnerVolumeSpecName "kube-api-access-2k9vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:25:41.719971 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.719895    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f19592c0-e059-4336-8b5b-934b6c55fbc8-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:41.719971 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:41.719922    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2k9vk\" (UniqueName: \"kubernetes.io/projected/f19592c0-e059-4336-8b5b-934b6c55fbc8-kube-api-access-2k9vk\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:42.335204 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.335122    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq"
Oct 29 23:25:42.335385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.335172    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-5631b502-4b8jq" event={"ID":"f19592c0-e059-4336-8b5b-934b6c55fbc8","Type":"ContainerDied","Data":"224e3be3c05a8d18a8e1c0f0244e562ed36ffb6659aef3010e3e52368b8321db"}
Oct 29 23:25:42.335385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.335252    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="224e3be3c05a8d18a8e1c0f0244e562ed36ffb6659aef3010e3e52368b8321db"
Oct 29 23:25:42.337036 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.337010    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" event={"ID":"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396","Type":"ContainerStarted","Data":"86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a"}
Oct 29 23:25:42.337190 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.337052    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" event={"ID":"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396","Type":"ContainerStarted","Data":"444411200d877206f8791d01f66396013c4d6885c3d64971b36b523d756fd4ac"}
Oct 29 23:25:42.384701 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.384665    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:42.415020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:42.414970    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podStartSLOduration=2.414954726 podStartE2EDuration="2.414954726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:42.402113447 +0000 UTC m=+753.713357773" watchObservedRunningTime="2026-10-29 23:25:42.414954726 +0000 UTC m=+753.726199116"
Oct 29 23:25:43.131007 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:43.130976    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:43.132156 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:43.132133    5044 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 29 23:25:43.132269 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:43.132194    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 29 23:25:44.131421 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:44.131387    5044 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 29 23:25:44.131870 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:44.131444    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 29 23:25:44.215075 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:44.215035    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:45.131123 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:45.131090    5044 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 29 23:25:45.131318 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:45.131143    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 29 23:25:45.891944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:45.891893    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:46.131611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:46.131574    5044 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 29 23:25:46.131778 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:46.131636    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 29 23:25:47.001367 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.001323    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"]
Oct 29 23:25:47.002168 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.002147    5044 cpu_manager.go:414] "containerMap: removing container" podUID="f19592c0-e059-4336-8b5b-934b6c55fbc8" containerName="revoke-keys"
Oct 29 23:25:47.002220 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.002173    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f19592c0-e059-4336-8b5b-934b6c55fbc8" containerName="revoke-keys"
Oct 29 23:25:47.002360 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.002347    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="f19592c0-e059-4336-8b5b-934b6c55fbc8" containerName="revoke-keys"
Oct 29 23:25:47.006570 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.006551    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.016890 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.016861    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8ls9\" (UniqueName: \"kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.017023 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.017010    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.017089 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.017055    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.021466 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.021444    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:25:47.042502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.034776    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:25:47.042502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.034928    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:25:47.042502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.040616    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"]
Oct 29 23:25:47.042502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.041303    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:25:47.118702 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.118661    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8ls9\" (UniqueName: \"kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.118879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.118776    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.118879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.118821    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.120231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.120205    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.124512 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.121977    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.132205 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.131987    5044 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 29 23:25:47.132205 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.132051    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 29 23:25:47.142326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.142301    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8ls9\" (UniqueName: \"kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9\") pod \"maas-api-revoke-sub-37306811-x5sp7\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.324727 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.324631    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:47.690055 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.690009    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"]
Oct 29 23:25:47.706470 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:47.700166    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:48.244992 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:48.244962    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:48.245489 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:48.245402    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:48.246144 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:48.246125    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:25:48.394673 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:48.394634    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7" event={"ID":"49165538-2f7c-493d-865a-f08fc0298ad9","Type":"ContainerStarted","Data":"e2ed0d58a056ed9d7871da1ba03a198c1a25614e57def806ca4589db6fdbe467"}
Oct 29 23:25:48.394830 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:48.394699    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7" event={"ID":"49165538-2f7c-493d-865a-f08fc0298ad9","Type":"ContainerStarted","Data":"09f375528a995fc4a5bb758ef839241021e73043c08c9a5e01ca74227fd9f83c"}
Oct 29 23:25:48.431449 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:48.431399    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7" podStartSLOduration=2.4313847219999998 podStartE2EDuration="2.431384722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:48.43036994 +0000 UTC m=+759.741614265" watchObservedRunningTime="2026-10-29 23:25:48.431384722 +0000 UTC m=+759.742629047"
Oct 29 23:25:49.410783 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:49.410751    5044 generic.go:356] "Generic (PLEG): container finished" podID="49165538-2f7c-493d-865a-f08fc0298ad9" containerID="e2ed0d58a056ed9d7871da1ba03a198c1a25614e57def806ca4589db6fdbe467" exitCode=0
Oct 29 23:25:49.411169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:49.410811    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7" event={"ID":"49165538-2f7c-493d-865a-f08fc0298ad9","Type":"ContainerDied","Data":"e2ed0d58a056ed9d7871da1ba03a198c1a25614e57def806ca4589db6fdbe467"}
Oct 29 23:25:49.489738 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:49.489702    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:50.555141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.555116    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:50.569945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.569923    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca\") pod \"49165538-2f7c-493d-865a-f08fc0298ad9\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") "
Oct 29 23:25:50.570085 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.569959    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9\" (UniqueName: \"kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9\") pod \"49165538-2f7c-493d-865a-f08fc0298ad9\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") "
Oct 29 23:25:50.570085 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.570036    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca\") pod \"49165538-2f7c-493d-865a-f08fc0298ad9\" (UID: \"49165538-2f7c-493d-865a-f08fc0298ad9\") "
Oct 29 23:25:50.570319 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.570295    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca" pod "49165538-2f7c-493d-865a-f08fc0298ad9" (UID: "49165538-2f7c-493d-865a-f08fc0298ad9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:25:50.570471 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.570454    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:50.572138 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.572118    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca" pod "49165538-2f7c-493d-865a-f08fc0298ad9" (UID: "49165538-2f7c-493d-865a-f08fc0298ad9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:25:50.572235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.572218    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9" pod "49165538-2f7c-493d-865a-f08fc0298ad9" (UID: "49165538-2f7c-493d-865a-f08fc0298ad9"). InnerVolumeSpecName "kube-api-access-t8ls9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:25:50.671673 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.671593    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8ls9\" (UniqueName: \"kubernetes.io/projected/49165538-2f7c-493d-865a-f08fc0298ad9-kube-api-access-t8ls9\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:50.671673 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:50.671618    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49165538-2f7c-493d-865a-f08fc0298ad9-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:25:51.294841 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:51.294794    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:51.424136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:51.424105    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7"
Oct 29 23:25:51.424136 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:51.424125    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-37306811-x5sp7" event={"ID":"49165538-2f7c-493d-865a-f08fc0298ad9","Type":"ContainerDied","Data":"09f375528a995fc4a5bb758ef839241021e73043c08c9a5e01ca74227fd9f83c"}
Oct 29 23:25:51.424334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:51.424175    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09f375528a995fc4a5bb758ef839241021e73043c08c9a5e01ca74227fd9f83c"
Oct 29 23:25:53.088728 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:53.088685    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:54.813160 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:54.813107    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:56.700601 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:56.700560    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:57.353207 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.353173    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"]
Oct 29 23:25:57.353721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.353702    5044 cpu_manager.go:414] "containerMap: removing container" podUID="49165538-2f7c-493d-865a-f08fc0298ad9" containerName="revoke-keys"
Oct 29 23:25:57.353721 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.353719    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49165538-2f7c-493d-865a-f08fc0298ad9" containerName="revoke-keys"
Oct 29 23:25:57.353911 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.353804    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="49165538-2f7c-493d-865a-f08fc0298ad9" containerName="revoke-keys"
Oct 29 23:25:57.357081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.357065    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.372581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.372557    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:25:57.375742 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.375719    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"]
Oct 29 23:25:57.383854 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.383822    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:25:57.383854 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.383823    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:25:57.383983 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.383828    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:25:57.452804 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.452773    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.452951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.452829    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.453019 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.452996    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkrbs\" (UniqueName: \"kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.554200 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.554169    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.554375 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.554237    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.554442 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.554385    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkrbs\" (UniqueName: \"kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.554879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.554855    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.556663 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.556641    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.572913 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.572890    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkrbs\" (UniqueName: \"kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs\") pod \"maas-api-revoke-sub-8a907349-d4xnn\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.670334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.670263    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:25:57.963346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:57.963314    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"]
Oct 29 23:25:57.964599 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:25:57.964572    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e254527_d4df_45d3_87a5_a07f0f3a3ec2.slice/crio-5b07763ab8ec97959874110d06f22a1164ade7846d2417652cb8e486fb774036 WatchSource:0}: Error finding container 5b07763ab8ec97959874110d06f22a1164ade7846d2417652cb8e486fb774036: Status 404 returned error can't find the container with id 5b07763ab8ec97959874110d06f22a1164ade7846d2417652cb8e486fb774036
Oct 29 23:25:58.473889 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:58.473837    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:58.475021 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:58.474988    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn" event={"ID":"6e254527-d4df-45d3-87a5-a07f0f3a3ec2","Type":"ContainerStarted","Data":"b0c74ab122a4da02bd5d8d67e66449d54ef433572845fb10f4eca9434e78b75c"}
Oct 29 23:25:58.475162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:58.475056    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn" event={"ID":"6e254527-d4df-45d3-87a5-a07f0f3a3ec2","Type":"ContainerStarted","Data":"5b07763ab8ec97959874110d06f22a1164ade7846d2417652cb8e486fb774036"}
Oct 29 23:25:58.512354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:58.512285    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn" podStartSLOduration=1.512270505 podStartE2EDuration="1.512270505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:25:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:25:58.511132739 +0000 UTC m=+769.822377065" watchObservedRunningTime="2026-10-29 23:25:58.512270505 +0000 UTC m=+769.823514830"
Oct 29 23:25:59.456770 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:59.456733    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:25:59.482393 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:59.482366    5044 generic.go:356] "Generic (PLEG): container finished" podID="6e254527-d4df-45d3-87a5-a07f0f3a3ec2" containerID="b0c74ab122a4da02bd5d8d67e66449d54ef433572845fb10f4eca9434e78b75c" exitCode=0
Oct 29 23:25:59.482571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:25:59.482448    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn" event={"ID":"6e254527-d4df-45d3-87a5-a07f0f3a3ec2","Type":"ContainerDied","Data":"b0c74ab122a4da02bd5d8d67e66449d54ef433572845fb10f4eca9434e78b75c"}
Oct 29 23:26:00.272380 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.272350    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:00.642337 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.642308    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:26:00.687764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.687736    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs\" (UniqueName: \"kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs\") pod \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") "
Oct 29 23:26:00.687943 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.687834    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca\") pod \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") "
Oct 29 23:26:00.688010 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.687979    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca\") pod \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\" (UID: \"6e254527-d4df-45d3-87a5-a07f0f3a3ec2\") "
Oct 29 23:26:00.688232 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.688206    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca" pod "6e254527-d4df-45d3-87a5-a07f0f3a3ec2" (UID: "6e254527-d4df-45d3-87a5-a07f0f3a3ec2"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:26:00.688382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.688365    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:26:00.689916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.689891    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs" pod "6e254527-d4df-45d3-87a5-a07f0f3a3ec2" (UID: "6e254527-d4df-45d3-87a5-a07f0f3a3ec2"). InnerVolumeSpecName "kube-api-access-wkrbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:26:00.690027 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.689922    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca" pod "6e254527-d4df-45d3-87a5-a07f0f3a3ec2" (UID: "6e254527-d4df-45d3-87a5-a07f0f3a3ec2"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:26:00.789918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.789890    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:26:00.789918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:00.789920    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkrbs\" (UniqueName: \"kubernetes.io/projected/6e254527-d4df-45d3-87a5-a07f0f3a3ec2-kube-api-access-wkrbs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:26:01.495624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:01.495590    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn"
Oct 29 23:26:01.495624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:01.495618    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-8a907349-d4xnn" event={"ID":"6e254527-d4df-45d3-87a5-a07f0f3a3ec2","Type":"ContainerDied","Data":"5b07763ab8ec97959874110d06f22a1164ade7846d2417652cb8e486fb774036"}
Oct 29 23:26:01.495828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:01.495661    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b07763ab8ec97959874110d06f22a1164ade7846d2417652cb8e486fb774036"
Oct 29 23:26:01.984382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:01.984349    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:03.901607 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:03.901570    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:05.368295 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:05.368264    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:07.166102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:07.166067    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:08.993193 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:08.993155    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:10.526607 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:26:10.526572    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:26:10.782294 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:10.782193    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:12.589701 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:12.589662    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:14.294012 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:14.293968    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:15.979892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:15.979854    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:17.666598 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:17.666553    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:19.378171 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:19.378126    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:21.092296 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:21.092257    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:23.138363 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:23.138328    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:24.580005 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:24.579969    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:26.288112 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:26.288073    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:28.074586 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:28.074553    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:29.863368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:29.863331    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:31.584671 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:31.584629    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:33.357347 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:33.357298    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:35.058436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:35.058385    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:36.709090 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:36.709041    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:38.453623 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:38.453587    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:40.178703 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:40.178665    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:40.527268 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:26:40.527231    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:26:41.918069 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:41.918022    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:43.558734 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:43.558694    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:45.289811 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:45.289765    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:47.016838 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:47.016804    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:48.790082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:48.790042    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:48.921898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:48.921860    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:50.634459 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:50.634411    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:52.428606 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:52.428565    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:54.187374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:54.187306    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:55.889747 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:55.889716    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:57.581290 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:57.581236    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:59.274515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:59.274462    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:26:59.573563 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:26:59.573459    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:01.097362 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.097310    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:01.707808 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.707771    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:01.919462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.919425    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"]
Oct 29 23:27:01.919985 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.919971    5044 cpu_manager.go:414] "containerMap: removing container" podUID="6e254527-d4df-45d3-87a5-a07f0f3a3ec2" containerName="revoke-keys"
Oct 29 23:27:01.920036 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.919989    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e254527-d4df-45d3-87a5-a07f0f3a3ec2" containerName="revoke-keys"
Oct 29 23:27:01.920114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.920103    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e254527-d4df-45d3-87a5-a07f0f3a3ec2" containerName="revoke-keys"
Oct 29 23:27:01.923400 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.923385    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:01.942962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.942936    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"]
Oct 29 23:27:01.948777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.948756    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:01.948898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.948787    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:01.948898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.948826    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:01.948898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.948872    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:01.971902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.971880    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhvwn\" (UniqueName: \"kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:01.972015 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.971920    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:01.972055 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:01.972028    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.072997 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.072967    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhvwn\" (UniqueName: \"kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.073177 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.073017    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.073177 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.073068    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.073817 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.073789    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.075323 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.075303    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.091937 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.091911    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhvwn\" (UniqueName: \"kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn\") pod \"maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.237125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.237048    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:02.531794 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.531763    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"]
Oct 29 23:27:02.532879 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:02.532857    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79054173_3873_404f_98f6_c0776772728d.slice/crio-63490c4071cc1806ff965df51973a6e7138ae50636f5a56a25a21c746cef894b WatchSource:0}: Error finding container 63490c4071cc1806ff965df51973a6e7138ae50636f5a56a25a21c746cef894b: Status 404 returned error can't find the container with id 63490c4071cc1806ff965df51973a6e7138ae50636f5a56a25a21c746cef894b
Oct 29 23:27:02.886278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.886233    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf" event={"ID":"79054173-3873-404f-98f6-c0776772728d","Type":"ContainerStarted","Data":"a8acff1ae14f94fbaeb24a21f40efce27c36d252a042dac56caec8d2cbb84141"}
Oct 29 23:27:02.886424 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.886316    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf" event={"ID":"79054173-3873-404f-98f6-c0776772728d","Type":"ContainerStarted","Data":"63490c4071cc1806ff965df51973a6e7138ae50636f5a56a25a21c746cef894b"}
Oct 29 23:27:02.935515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:02.935436    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf" podStartSLOduration=1.9354172429999998 podStartE2EDuration="1.935417243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:02.931424675 +0000 UTC m=+834.242669001" watchObservedRunningTime="2026-10-29 23:27:02.935417243 +0000 UTC m=+834.246661569"
Oct 29 23:27:03.024043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:03.024007    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:03.161529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:03.161406    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:03.894346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:03.894261    5044 generic.go:356] "Generic (PLEG): container finished" podID="79054173-3873-404f-98f6-c0776772728d" containerID="a8acff1ae14f94fbaeb24a21f40efce27c36d252a042dac56caec8d2cbb84141" exitCode=0
Oct 29 23:27:03.894346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:03.894324    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf" event={"ID":"79054173-3873-404f-98f6-c0776772728d","Type":"ContainerDied","Data":"a8acff1ae14f94fbaeb24a21f40efce27c36d252a042dac56caec8d2cbb84141"}
Oct 29 23:27:04.970564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:04.970519    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:05.061159 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.061131    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:05.112927 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.112897    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn\" (UniqueName: \"kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn\") pod \"79054173-3873-404f-98f6-c0776772728d\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") "
Oct 29 23:27:05.113095 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.113079    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca\") pod \"79054173-3873-404f-98f6-c0776772728d\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") "
Oct 29 23:27:05.113138 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.113123    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca\") pod \"79054173-3873-404f-98f6-c0776772728d\" (UID: \"79054173-3873-404f-98f6-c0776772728d\") "
Oct 29 23:27:05.113401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.113374    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca" pod "79054173-3873-404f-98f6-c0776772728d" (UID: "79054173-3873-404f-98f6-c0776772728d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:05.113553 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.113487    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/79054173-3873-404f-98f6-c0776772728d-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:05.114965 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.114940    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn" pod "79054173-3873-404f-98f6-c0776772728d" (UID: "79054173-3873-404f-98f6-c0776772728d"). InnerVolumeSpecName "kube-api-access-mhvwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:05.115073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.115054    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca" pod "79054173-3873-404f-98f6-c0776772728d" (UID: "79054173-3873-404f-98f6-c0776772728d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:05.214513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.214411    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/79054173-3873-404f-98f6-c0776772728d-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:05.214513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.214439    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhvwn\" (UniqueName: \"kubernetes.io/projected/79054173-3873-404f-98f6-c0776772728d-kube-api-access-mhvwn\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:05.908996 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.908971    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"
Oct 29 23:27:05.909161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.908972    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf" event={"ID":"79054173-3873-404f-98f6-c0776772728d","Type":"ContainerDied","Data":"63490c4071cc1806ff965df51973a6e7138ae50636f5a56a25a21c746cef894b"}
Oct 29 23:27:05.909161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:05.909084    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63490c4071cc1806ff965df51973a6e7138ae50636f5a56a25a21c746cef894b"
Oct 29 23:27:06.629587 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.629552    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"]
Oct 29 23:27:06.671559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.671470    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:06.813827 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.813771    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:06.835389 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.835359    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"]
Oct 29 23:27:06.835884 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.835869    5044 cpu_manager.go:414] "containerMap: removing container" podUID="79054173-3873-404f-98f6-c0776772728d" containerName="revoke-keys"
Oct 29 23:27:06.835932 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.835887    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79054173-3873-404f-98f6-c0776772728d" containerName="revoke-keys"
Oct 29 23:27:06.835998 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.835989    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="79054173-3873-404f-98f6-c0776772728d" containerName="revoke-keys"
Oct 29 23:27:06.839310 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.839293    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:06.856664 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.855535    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:06.856664 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.855675    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:06.856664 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.855759    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:06.856664 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.855797    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:06.862239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.862209    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"]
Oct 29 23:27:06.933650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.933564    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2rmv\" (UniqueName: \"kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:06.933831 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.933709    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:06.933831 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:06.933802    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.034960 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.034922    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.035141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.034985    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.035141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.035133    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2rmv\" (UniqueName: \"kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.035724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.035699    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.037235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.037212    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.052891 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.052869    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2rmv\" (UniqueName: \"kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv\") pod \"maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.152356 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.152323    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:07.446297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.446266    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"]
Oct 29 23:27:07.447444 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:07.447419    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012b5128_77d5_453e_a594_19af2aa19acf.slice/crio-1ea3f5900cec552ba1d90504e3d10a475eb3c0d554f558d44c362060ad354f81 WatchSource:0}: Error finding container 1ea3f5900cec552ba1d90504e3d10a475eb3c0d554f558d44c362060ad354f81: Status 404 returned error can't find the container with id 1ea3f5900cec552ba1d90504e3d10a475eb3c0d554f558d44c362060ad354f81
Oct 29 23:27:07.922942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.922909    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f" event={"ID":"012b5128-77d5-453e-a594-19af2aa19acf","Type":"ContainerStarted","Data":"95b3c600d29eac5c7a537233df8575216340dc19dfe2cdb5df26ad6c8a6c91de"}
Oct 29 23:27:07.923307 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.922960    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f" event={"ID":"012b5128-77d5-453e-a594-19af2aa19acf","Type":"ContainerStarted","Data":"1ea3f5900cec552ba1d90504e3d10a475eb3c0d554f558d44c362060ad354f81"}
Oct 29 23:27:07.959084 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:07.959036    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f" podStartSLOduration=1.959024241 podStartE2EDuration="1.959024241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:07.95813315 +0000 UTC m=+839.269377475" watchObservedRunningTime="2026-10-29 23:27:07.959024241 +0000 UTC m=+839.270268566"
Oct 29 23:27:08.811190 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:08.811145    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:08.930297 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:08.930265    5044 generic.go:356] "Generic (PLEG): container finished" podID="012b5128-77d5-453e-a594-19af2aa19acf" containerID="95b3c600d29eac5c7a537233df8575216340dc19dfe2cdb5df26ad6c8a6c91de" exitCode=0
Oct 29 23:27:08.930768 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:08.930360    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f" event={"ID":"012b5128-77d5-453e-a594-19af2aa19acf","Type":"ContainerDied","Data":"95b3c600d29eac5c7a537233df8575216340dc19dfe2cdb5df26ad6c8a6c91de"}
Oct 29 23:27:09.057545 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:09.057507    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:10.091210 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.091188    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:10.171073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.171042    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv\" (UniqueName: \"kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv\") pod \"012b5128-77d5-453e-a594-19af2aa19acf\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") "
Oct 29 23:27:10.171226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.171181    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca\") pod \"012b5128-77d5-453e-a594-19af2aa19acf\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") "
Oct 29 23:27:10.171226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.171211    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca\") pod \"012b5128-77d5-453e-a594-19af2aa19acf\" (UID: \"012b5128-77d5-453e-a594-19af2aa19acf\") "
Oct 29 23:27:10.171582 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.171553    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca" pod "012b5128-77d5-453e-a594-19af2aa19acf" (UID: "012b5128-77d5-453e-a594-19af2aa19acf"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:10.173140 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.173106    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv" pod "012b5128-77d5-453e-a594-19af2aa19acf" (UID: "012b5128-77d5-453e-a594-19af2aa19acf"). InnerVolumeSpecName "kube-api-access-l2rmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:10.173251 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.173229    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca" pod "012b5128-77d5-453e-a594-19af2aa19acf" (UID: "012b5128-77d5-453e-a594-19af2aa19acf"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:10.272720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.272685    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:10.272720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.272717    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/012b5128-77d5-453e-a594-19af2aa19acf-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:10.272720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.272726    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2rmv\" (UniqueName: \"kubernetes.io/projected/012b5128-77d5-453e-a594-19af2aa19acf-kube-api-access-l2rmv\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:10.526616 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:10.526536    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:27:10.835127 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.835037    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:10.945923 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.945893    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"
Oct 29 23:27:10.945923 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.945911    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f" event={"ID":"012b5128-77d5-453e-a594-19af2aa19acf","Type":"ContainerDied","Data":"1ea3f5900cec552ba1d90504e3d10a475eb3c0d554f558d44c362060ad354f81"}
Oct 29 23:27:10.946107 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:10.945957    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ea3f5900cec552ba1d90504e3d10a475eb3c0d554f558d44c362060ad354f81"
Oct 29 23:27:11.557415 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:11.556179    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"]
Oct 29 23:27:11.753791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:11.753753    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:12.344332 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:12.344293    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"]
Oct 29 23:27:12.376666 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:12.376634    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"]
Oct 29 23:27:12.527308 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:12.527276    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:12.682529 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:12.682396    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:13.882651 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:13.882616    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"]
Oct 29 23:27:14.046187 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:14.046153    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:14.493784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:14.493738    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:16.196651 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:16.196614    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:17.344793 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.344742    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerName="payload-processing" containerID="cri-o://36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39" gracePeriod=25
Oct 29 23:27:17.377636 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.377558    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerName="payload-pre-processing" containerID="cri-o://f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f" gracePeriod=25
Oct 29 23:27:17.452193 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.452153    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:17.595326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.595233    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:17.657802 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.657775    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"]
Oct 29 23:27:17.658461 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.658442    5044 cpu_manager.go:414] "containerMap: removing container" podUID="012b5128-77d5-453e-a594-19af2aa19acf" containerName="revoke-keys"
Oct 29 23:27:17.658527 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.658465    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="012b5128-77d5-453e-a594-19af2aa19acf" containerName="revoke-keys"
Oct 29 23:27:17.658644 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.658631    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="012b5128-77d5-453e-a594-19af2aa19acf" containerName="revoke-keys"
Oct 29 23:27:17.662423 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.662403    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.689249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.689159    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:17.689249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.689182    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:17.689249 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.689215    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:17.689540 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.689283    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:17.694314 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.694287    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"]
Oct 29 23:27:17.755920 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.755893    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.756069 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.756049    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.756177 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.756163    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9f7d\" (UniqueName: \"kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.856907 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.856829    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.857049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.856930    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9f7d\" (UniqueName: \"kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.857049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.856963    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.857463 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.857424    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.859332 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.859309    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:17.879704 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:17.879644    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9f7d\" (UniqueName: \"kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d\") pod \"maas-api-revoke-sub-9cb5ca21-pdcl4\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:18.009619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:18.009583    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:18.123397 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:18.121119    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:18.332346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:18.332322    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"]
Oct 29 23:27:18.335279 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:18.335237    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef11e685_5645_4c33_ad20_f499925f7924.slice/crio-61dd9e8bcbb3523806c739797ea87f3c3ef47cebdfd3390366897adc3e5def94 WatchSource:0}: Error finding container 61dd9e8bcbb3523806c739797ea87f3c3ef47cebdfd3390366897adc3e5def94: Status 404 returned error can't find the container with id 61dd9e8bcbb3523806c739797ea87f3c3ef47cebdfd3390366897adc3e5def94
Oct 29 23:27:19.002256 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.002217    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4" event={"ID":"ef11e685-5645-4c33-ad20-f499925f7924","Type":"ContainerStarted","Data":"00712c126273b80e373656fdaf7e6ce9056c3ceda6a4e0f07c35594bf9f70622"}
Oct 29 23:27:19.002691 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.002279    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4" event={"ID":"ef11e685-5645-4c33-ad20-f499925f7924","Type":"ContainerStarted","Data":"61dd9e8bcbb3523806c739797ea87f3c3ef47cebdfd3390366897adc3e5def94"}
Oct 29 23:27:19.038945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.038872    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4" podStartSLOduration=2.038858242 podStartE2EDuration="2.038858242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:19.038729821 +0000 UTC m=+850.349974158" watchObservedRunningTime="2026-10-29 23:27:19.038858242 +0000 UTC m=+850.350102566"
Oct 29 23:27:19.400366 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.400275    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:19.400366 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.400275    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:19.666715 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.666616    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:19.666898 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.666877    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"]
Oct 29 23:27:19.694845 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.694813    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"]
Oct 29 23:27:19.837671 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.837595    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:19.976894 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:19.976858    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:20.011349 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:20.011316    5044 generic.go:356] "Generic (PLEG): container finished" podID="ef11e685-5645-4c33-ad20-f499925f7924" containerID="00712c126273b80e373656fdaf7e6ce9056c3ceda6a4e0f07c35594bf9f70622" exitCode=0
Oct 29 23:27:20.011753 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:20.011397    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4" event={"ID":"ef11e685-5645-4c33-ad20-f499925f7924","Type":"ContainerDied","Data":"00712c126273b80e373656fdaf7e6ce9056c3ceda6a4e0f07c35594bf9f70622"}
Oct 29 23:27:20.117016 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:20.116980    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:21.171264 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.171234    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:21.202837 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.202808    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d\" (UniqueName: \"kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d\") pod \"ef11e685-5645-4c33-ad20-f499925f7924\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") "
Oct 29 23:27:21.202991 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.202853    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca\") pod \"ef11e685-5645-4c33-ad20-f499925f7924\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") "
Oct 29 23:27:21.202991 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.202914    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca\") pod \"ef11e685-5645-4c33-ad20-f499925f7924\" (UID: \"ef11e685-5645-4c33-ad20-f499925f7924\") "
Oct 29 23:27:21.203280 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.203247    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca" pod "ef11e685-5645-4c33-ad20-f499925f7924" (UID: "ef11e685-5645-4c33-ad20-f499925f7924"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:21.204942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.204912    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d" pod "ef11e685-5645-4c33-ad20-f499925f7924" (UID: "ef11e685-5645-4c33-ad20-f499925f7924"). InnerVolumeSpecName "kube-api-access-w9f7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:21.205082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.204959    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca" pod "ef11e685-5645-4c33-ad20-f499925f7924" (UID: "ef11e685-5645-4c33-ad20-f499925f7924"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:21.304808 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.304723    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:21.304808 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.304753    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ef11e685-5645-4c33-ad20-f499925f7924-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:21.304808 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.304762    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9f7d\" (UniqueName: \"kubernetes.io/projected/ef11e685-5645-4c33-ad20-f499925f7924-kube-api-access-w9f7d\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:21.650279 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.650187    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" podUID="0a93de89-45c1-4bc1-9f61-5486d25dab16" containerName="main" containerID="cri-o://b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576" gracePeriod=45
Oct 29 23:27:21.782171 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.782132    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:21.916772 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:21.916746    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:27:22.011764 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.011735    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache\") pod \"0a93de89-45c1-4bc1-9f61-5486d25dab16\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") "
Oct 29 23:27:22.011951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.011841    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir\") pod \"0a93de89-45c1-4bc1-9f61-5486d25dab16\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") "
Oct 29 23:27:22.011951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.011929    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs\" (UniqueName: \"kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs\") pod \"0a93de89-45c1-4bc1-9f61-5486d25dab16\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") "
Oct 29 23:27:22.012070 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.011991    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home\") pod \"0a93de89-45c1-4bc1-9f61-5486d25dab16\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") "
Oct 29 23:27:22.012070 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012023    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn\" (UniqueName: \"kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn\") pod \"0a93de89-45c1-4bc1-9f61-5486d25dab16\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") "
Oct 29 23:27:22.012070 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012025    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache" pod "0a93de89-45c1-4bc1-9f61-5486d25dab16" (UID: "0a93de89-45c1-4bc1-9f61-5486d25dab16"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:22.012070 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012067    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm\") pod \"0a93de89-45c1-4bc1-9f61-5486d25dab16\" (UID: \"0a93de89-45c1-4bc1-9f61-5486d25dab16\") "
Oct 29 23:27:22.012520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012133    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir" pod "0a93de89-45c1-4bc1-9f61-5486d25dab16" (UID: "0a93de89-45c1-4bc1-9f61-5486d25dab16"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:22.012520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012236    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home" pod "0a93de89-45c1-4bc1-9f61-5486d25dab16" (UID: "0a93de89-45c1-4bc1-9f61-5486d25dab16"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:22.012520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012494    5044 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-tmp-dir\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:22.012691 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012525    5044 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-home\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:22.012691 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.012540    5044 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-model-cache\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:22.014328 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.014297    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm" pod "0a93de89-45c1-4bc1-9f61-5486d25dab16" (UID: "0a93de89-45c1-4bc1-9f61-5486d25dab16"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:22.014489 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.014458    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs" pod "0a93de89-45c1-4bc1-9f61-5486d25dab16" (UID: "0a93de89-45c1-4bc1-9f61-5486d25dab16"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:22.014677 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.014659    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn" pod "0a93de89-45c1-4bc1-9f61-5486d25dab16" (UID: "0a93de89-45c1-4bc1-9f61-5486d25dab16"). InnerVolumeSpecName "kube-api-access-jr5jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:22.025372 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.025347    5044 generic.go:356] "Generic (PLEG): container finished" podID="0a93de89-45c1-4bc1-9f61-5486d25dab16" containerID="b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576" exitCode=0
Oct 29 23:27:22.025544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.025406    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"
Oct 29 23:27:22.025544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.025425    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" event={"ID":"0a93de89-45c1-4bc1-9f61-5486d25dab16","Type":"ContainerDied","Data":"b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576"}
Oct 29 23:27:22.025544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.025468    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" event={"ID":"0a93de89-45c1-4bc1-9f61-5486d25dab16","Type":"ContainerDied","Data":"0a95c4a902476ba49011217b0f3615d0dbd431c8fab4581ca48cbf0a9e741d79"}
Oct 29 23:27:22.025544 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.025505    5044 scope.go:122] "RemoveContainer" containerID="b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576"
Oct 29 23:27:22.027015 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.026995    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4" event={"ID":"ef11e685-5645-4c33-ad20-f499925f7924","Type":"ContainerDied","Data":"61dd9e8bcbb3523806c739797ea87f3c3ef47cebdfd3390366897adc3e5def94"}
Oct 29 23:27:22.027097 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.027037    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61dd9e8bcbb3523806c739797ea87f3c3ef47cebdfd3390366897adc3e5def94"
Oct 29 23:27:22.027097 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.027086    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9cb5ca21-pdcl4"
Oct 29 23:27:22.036230 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.036213    5044 scope.go:122] "RemoveContainer" containerID="b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576"
Oct 29 23:27:22.036541 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:22.036515    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576\": container with ID starting with b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576 not found: ID does not exist" containerID="b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576"
Oct 29 23:27:22.036636 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.036547    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576"} err="failed to get container status \"b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576\": rpc error: code = NotFound desc = could not find container \"b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576\": container with ID starting with b7096c9aef0ef69a8a60e06d6389b6c08c6b6f371f1337186e1e2b9339adf576 not found: ID does not exist"
Oct 29 23:27:22.096219 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.096186    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"]
Oct 29 23:27:22.102913 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.102887    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn"]
Oct 29 23:27:22.113449 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.113425    5044 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a93de89-45c1-4bc1-9f61-5486d25dab16-tls-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:22.113449 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.113448    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr5jn\" (UniqueName: \"kubernetes.io/projected/0a93de89-45c1-4bc1-9f61-5486d25dab16-kube-api-access-jr5jn\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:22.113652 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.113459    5044 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0a93de89-45c1-4bc1-9f61-5486d25dab16-dshm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:22.821444 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.821407    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a93de89-45c1-4bc1-9f61-5486d25dab16" path="/var/lib/kubelet/pods/0a93de89-45c1-4bc1-9f61-5486d25dab16/volumes"
Oct 29 23:27:22.873912 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:22.873877    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-b2c5f2/simulator-w1-b2c5f2-kserve-6d566b8bb8-ln2qn" podUID="0a93de89-45c1-4bc1-9f61-5486d25dab16" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 29 23:27:23.490224 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:23.490185    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:24.668070 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:24.668031    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerName="payload-processing" containerID="cri-o://a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38" gracePeriod=25
Oct 29 23:27:24.695733 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:24.695686    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerName="payload-pre-processing" containerID="cri-o://f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359" gracePeriod=25
Oct 29 23:27:25.125106 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125067    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"]
Oct 29 23:27:25.125624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125607    5044 cpu_manager.go:414] "containerMap: removing container" podUID="0a93de89-45c1-4bc1-9f61-5486d25dab16" containerName="main"
Oct 29 23:27:25.125624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125624    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a93de89-45c1-4bc1-9f61-5486d25dab16" containerName="main"
Oct 29 23:27:25.125726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125639    5044 cpu_manager.go:414] "containerMap: removing container" podUID="ef11e685-5645-4c33-ad20-f499925f7924" containerName="revoke-keys"
Oct 29 23:27:25.125726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125644    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef11e685-5645-4c33-ad20-f499925f7924" containerName="revoke-keys"
Oct 29 23:27:25.125785 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125739    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef11e685-5645-4c33-ad20-f499925f7924" containerName="revoke-keys"
Oct 29 23:27:25.125785 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.125754    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a93de89-45c1-4bc1-9f61-5486d25dab16" containerName="main"
Oct 29 23:27:25.129134 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.129115    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.147193 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.147160    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.147349 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.147290    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.147349 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.147329    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnlwj\" (UniqueName: \"kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.151760 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.151736    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"]
Oct 29 23:27:25.159813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.159788    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:25.159947 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.159812    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:25.159947 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.159836    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:25.160229 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.160204    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:25.231336 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.231305    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"]
Oct 29 23:27:25.235100 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.235081    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.248134 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248106    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x2pb\" (UniqueName: \"kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.248248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248172    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.248248 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248219    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnlwj\" (UniqueName: \"kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.248344 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248326    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.248393 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248368    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.248515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248472    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.248859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.248841    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.250944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.250918    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.258124 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.258093    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"]
Oct 29 23:27:25.269166 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.269140    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnlwj\" (UniqueName: \"kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj\") pod \"maas-api-revoke-sub-55d44ce2-sdtdw\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.349423 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.349387    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.349608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.349450    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.349608 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.349503    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x2pb\" (UniqueName: \"kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.350039 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.350018    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.352043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.352020    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.368473 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.368449    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x2pb\" (UniqueName: \"kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb\") pod \"maas-api-revoke-sub-25562112-prrvb\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.442722 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.442652    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:25.550179 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.550145    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:25.755666 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.755639    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"]
Oct 29 23:27:25.757312 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:25.757284    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1438130c_5bd5_49ee_ab63_43628e2346ff.slice/crio-7f1c669ffa064d81b08e8a086ac6ddae51d15937f3d217ef7c796c3a7e5b3d5e WatchSource:0}: Error finding container 7f1c669ffa064d81b08e8a086ac6ddae51d15937f3d217ef7c796c3a7e5b3d5e: Status 404 returned error can't find the container with id 7f1c669ffa064d81b08e8a086ac6ddae51d15937f3d217ef7c796c3a7e5b3d5e
Oct 29 23:27:25.761341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.761309    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:25.873258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:25.873224    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"]
Oct 29 23:27:26.053222 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.053120    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw" event={"ID":"1438130c-5bd5-49ee-ab63-43628e2346ff","Type":"ContainerStarted","Data":"7f1c669ffa064d81b08e8a086ac6ddae51d15937f3d217ef7c796c3a7e5b3d5e"}
Oct 29 23:27:26.054493 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.054452    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb" event={"ID":"e8383cab-0805-42ba-b08c-d2edd8e5b056","Type":"ContainerStarted","Data":"a9304e8e3f958468064ff8ca5a238b2882adbe89dbb59caf839fdc027051ce5d"}
Oct 29 23:27:26.577258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.577220    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" podUID="c826d510-6313-4ad6-ba3b-9aa126d604e0" containerName="main" containerID="cri-o://082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953" gracePeriod=45
Oct 29 23:27:26.654413 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.654374    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" podUID="c826d510-6313-4ad6-ba3b-9aa126d604e0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": dial tcp 10.132.0.69:8000: connect: connection refused"
Oct 29 23:27:26.847575 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.847549    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:27:26.866682 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.866659    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs\" (UniqueName: \"kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs\") pod \"c826d510-6313-4ad6-ba3b-9aa126d604e0\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") "
Oct 29 23:27:26.866828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.866706    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache\") pod \"c826d510-6313-4ad6-ba3b-9aa126d604e0\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") "
Oct 29 23:27:26.866828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.866740    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home\") pod \"c826d510-6313-4ad6-ba3b-9aa126d604e0\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") "
Oct 29 23:27:26.866828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.866790    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir\") pod \"c826d510-6313-4ad6-ba3b-9aa126d604e0\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") "
Oct 29 23:27:26.866828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.866813    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl\" (UniqueName: \"kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl\") pod \"c826d510-6313-4ad6-ba3b-9aa126d604e0\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") "
Oct 29 23:27:26.867035 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.866840    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm\") pod \"c826d510-6313-4ad6-ba3b-9aa126d604e0\" (UID: \"c826d510-6313-4ad6-ba3b-9aa126d604e0\") "
Oct 29 23:27:26.867080 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.867032    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir" pod "c826d510-6313-4ad6-ba3b-9aa126d604e0" (UID: "c826d510-6313-4ad6-ba3b-9aa126d604e0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:26.867080 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.867050    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache" pod "c826d510-6313-4ad6-ba3b-9aa126d604e0" (UID: "c826d510-6313-4ad6-ba3b-9aa126d604e0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:26.867149 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.867071    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home" pod "c826d510-6313-4ad6-ba3b-9aa126d604e0" (UID: "c826d510-6313-4ad6-ba3b-9aa126d604e0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:26.867374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.867355    5044 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-model-cache\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:26.867374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.867372    5044 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-home\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:26.867539 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.867397    5044 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-tmp-dir\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:26.868995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.868973    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm" pod "c826d510-6313-4ad6-ba3b-9aa126d604e0" (UID: "c826d510-6313-4ad6-ba3b-9aa126d604e0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:26.869082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.869037    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs" pod "c826d510-6313-4ad6-ba3b-9aa126d604e0" (UID: "c826d510-6313-4ad6-ba3b-9aa126d604e0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:26.869082 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.869045    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl" pod "c826d510-6313-4ad6-ba3b-9aa126d604e0" (UID: "c826d510-6313-4ad6-ba3b-9aa126d604e0"). InnerVolumeSpecName "kube-api-access-gx6kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:26.968458 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.968427    5044 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c826d510-6313-4ad6-ba3b-9aa126d604e0-dshm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:26.968458 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.968456    5044 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c826d510-6313-4ad6-ba3b-9aa126d604e0-tls-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:26.968669 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.968467    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx6kl\" (UniqueName: \"kubernetes.io/projected/c826d510-6313-4ad6-ba3b-9aa126d604e0-kube-api-access-gx6kl\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:26.984010 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.983980    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"]
Oct 29 23:27:26.984487 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.984462    5044 cpu_manager.go:414] "containerMap: removing container" podUID="c826d510-6313-4ad6-ba3b-9aa126d604e0" containerName="main"
Oct 29 23:27:26.984535 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.984509    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c826d510-6313-4ad6-ba3b-9aa126d604e0" containerName="main"
Oct 29 23:27:26.984649 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.984640    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="c826d510-6313-4ad6-ba3b-9aa126d604e0" containerName="main"
Oct 29 23:27:26.988131 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:26.988114    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.008275 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.008248    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"]
Oct 29 23:27:27.061997 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.061967    5044 generic.go:356] "Generic (PLEG): container finished" podID="c826d510-6313-4ad6-ba3b-9aa126d604e0" containerID="082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953" exitCode=0
Oct 29 23:27:27.062174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.062014    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"
Oct 29 23:27:27.062174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.062047    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" event={"ID":"c826d510-6313-4ad6-ba3b-9aa126d604e0","Type":"ContainerDied","Data":"082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953"}
Oct 29 23:27:27.062174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.062086    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr" event={"ID":"c826d510-6313-4ad6-ba3b-9aa126d604e0","Type":"ContainerDied","Data":"b6c192a8f6356bf70c168c58d069634bfde541a2906848dcfaec4a62c4b94592"}
Oct 29 23:27:27.062174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.062102    5044 scope.go:122] "RemoveContainer" containerID="082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953"
Oct 29 23:27:27.063934 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.063909    5044 generic.go:356] "Generic (PLEG): container finished" podID="e8383cab-0805-42ba-b08c-d2edd8e5b056" containerID="8ab2202b3c61436ed5d7cbf3701bed61f253614ae5e4c04ad11e24701699a90c" exitCode=0
Oct 29 23:27:27.064041 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.063991    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb" event={"ID":"e8383cab-0805-42ba-b08c-d2edd8e5b056","Type":"ContainerDied","Data":"8ab2202b3c61436ed5d7cbf3701bed61f253614ae5e4c04ad11e24701699a90c"}
Oct 29 23:27:27.065856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.065833    5044 generic.go:356] "Generic (PLEG): container finished" podID="1438130c-5bd5-49ee-ab63-43628e2346ff" containerID="94fd5807a6a8914223c167ffcd5be4e0dfe590221d98eec1944cb3726d2ebd18" exitCode=0
Oct 29 23:27:27.065948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.065906    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw" event={"ID":"1438130c-5bd5-49ee-ab63-43628e2346ff","Type":"ContainerDied","Data":"94fd5807a6a8914223c167ffcd5be4e0dfe590221d98eec1944cb3726d2ebd18"}
Oct 29 23:27:27.069243 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069222    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069334 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069268    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069417 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069397    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069458 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069440    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069558 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069544    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069613 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069572    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069613 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069588    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl6fw\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069845 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069830    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.069910 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.069886    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.072639 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.072617    5044 scope.go:122] "RemoveContainer" containerID="082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953"
Oct 29 23:27:27.072878 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:27.072856    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953\": container with ID starting with 082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953 not found: ID does not exist" containerID="082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953"
Oct 29 23:27:27.072941 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.072885    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953"} err="failed to get container status \"082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953\": rpc error: code = NotFound desc = could not find container \"082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953\": container with ID starting with 082f99934f5fed2d62acc172438c14cff56d6a0f8f04362657e69ebe82093953 not found: ID does not exist"
Oct 29 23:27:27.110385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.110316    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"]
Oct 29 23:27:27.116614 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.116586    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-105882/simulator-w3-105882-kserve-6d85c7d848-qg6jr"]
Oct 29 23:27:27.170759 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.170731    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.170896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.170775    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.170896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.170836    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.170904    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.170936    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.170981    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171004    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171210 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171029    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl6fw\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171210 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171117    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171332 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171290    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171390 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171372    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171605    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171620    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.171786 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.171645    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.173191 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.173165    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.173528 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.173507    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.189508 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.189455    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.190020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.190003    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl6fw\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw\") pod \"e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") " pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.302645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.302618    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:27.571853 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.571809    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:27.610741 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.610712    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"]
Oct 29 23:27:27.612712 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:27.612640    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfc7e80_bc12_4d22_bc07_f9ff70ee6d17.slice/crio-be959668a8aa68d007ee31ebfdd61fc2d8b14a56ecf1dc812e512b0f459fa044 WatchSource:0}: Error finding container be959668a8aa68d007ee31ebfdd61fc2d8b14a56ecf1dc812e512b0f459fa044: Status 404 returned error can't find the container with id be959668a8aa68d007ee31ebfdd61fc2d8b14a56ecf1dc812e512b0f459fa044
Oct 29 23:27:27.616284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.616254    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:27:27.616392 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.616329    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:27:27.616392 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:27.616357    5044 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 29 23:27:28.074265 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.074234    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" event={"ID":"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17","Type":"ContainerStarted","Data":"ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b"}
Oct 29 23:27:28.074740 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.074289    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" event={"ID":"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17","Type":"ContainerStarted","Data":"be959668a8aa68d007ee31ebfdd61fc2d8b14a56ecf1dc812e512b0f459fa044"}
Oct 29 23:27:28.120530 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.119238    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podStartSLOduration=2.119216579 podStartE2EDuration="2.119216579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:28.114704201 +0000 UTC m=+859.425948539" watchObservedRunningTime="2026-10-29 23:27:28.119216579 +0000 UTC m=+859.430460909"
Oct 29 23:27:28.215180 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.215149    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:28.237265 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.237240    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:28.282962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.282932    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca\") pod \"e8383cab-0805-42ba-b08c-d2edd8e5b056\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") "
Oct 29 23:27:28.283120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.282984    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj\" (UniqueName: \"kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj\") pod \"1438130c-5bd5-49ee-ab63-43628e2346ff\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") "
Oct 29 23:27:28.283120 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283060    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca\") pod \"1438130c-5bd5-49ee-ab63-43628e2346ff\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") "
Oct 29 23:27:28.283233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283127    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca\") pod \"e8383cab-0805-42ba-b08c-d2edd8e5b056\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") "
Oct 29 23:27:28.283233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283190    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca\") pod \"1438130c-5bd5-49ee-ab63-43628e2346ff\" (UID: \"1438130c-5bd5-49ee-ab63-43628e2346ff\") "
Oct 29 23:27:28.283349 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283246    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb\" (UniqueName: \"kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb\") pod \"e8383cab-0805-42ba-b08c-d2edd8e5b056\" (UID: \"e8383cab-0805-42ba-b08c-d2edd8e5b056\") "
Oct 29 23:27:28.283349 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283304    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca" pod "e8383cab-0805-42ba-b08c-d2edd8e5b056" (UID: "e8383cab-0805-42ba-b08c-d2edd8e5b056"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:28.283645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283621    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca" pod "1438130c-5bd5-49ee-ab63-43628e2346ff" (UID: "1438130c-5bd5-49ee-ab63-43628e2346ff"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:28.283810 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283763    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:28.283810 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.283786    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:28.285337 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.285311    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca" pod "1438130c-5bd5-49ee-ab63-43628e2346ff" (UID: "1438130c-5bd5-49ee-ab63-43628e2346ff"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:28.285572 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.285534    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca" pod "e8383cab-0805-42ba-b08c-d2edd8e5b056" (UID: "e8383cab-0805-42ba-b08c-d2edd8e5b056"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:28.285833 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.285813    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj" pod "1438130c-5bd5-49ee-ab63-43628e2346ff" (UID: "1438130c-5bd5-49ee-ab63-43628e2346ff"). InnerVolumeSpecName "kube-api-access-dnlwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:28.285928 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.285912    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb" pod "e8383cab-0805-42ba-b08c-d2edd8e5b056" (UID: "e8383cab-0805-42ba-b08c-d2edd8e5b056"). InnerVolumeSpecName "kube-api-access-6x2pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:28.303222 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.303198    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:28.304600 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.304580    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:28.304701 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.304625    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:28.397757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.397660    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnlwj\" (UniqueName: \"kubernetes.io/projected/1438130c-5bd5-49ee-ab63-43628e2346ff-kube-api-access-dnlwj\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:28.397757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.397689    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1438130c-5bd5-49ee-ab63-43628e2346ff-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:28.397757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.397703    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e8383cab-0805-42ba-b08c-d2edd8e5b056-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:28.397757 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.397714    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x2pb\" (UniqueName: \"kubernetes.io/projected/e8383cab-0805-42ba-b08c-d2edd8e5b056-kube-api-access-6x2pb\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:28.830663 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.830628    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c826d510-6313-4ad6-ba3b-9aa126d604e0" path="/var/lib/kubelet/pods/c826d510-6313-4ad6-ba3b-9aa126d604e0/volumes"
Oct 29 23:27:28.903637 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:28.903587    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" podUID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" containerName="main" containerID="cri-o://d6f71cee04103eada1e4ac52f27688d4bd3601b7892488deb350994a88e75b3c" gracePeriod=45
Oct 29 23:27:29.100081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.099979    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb" event={"ID":"e8383cab-0805-42ba-b08c-d2edd8e5b056","Type":"ContainerDied","Data":"a9304e8e3f958468064ff8ca5a238b2882adbe89dbb59caf839fdc027051ce5d"}
Oct 29 23:27:29.100081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.100026    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a9304e8e3f958468064ff8ca5a238b2882adbe89dbb59caf839fdc027051ce5d"
Oct 29 23:27:29.100081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.100085    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-25562112-prrvb"
Oct 29 23:27:29.105065 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.103814    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw" event={"ID":"1438130c-5bd5-49ee-ab63-43628e2346ff","Type":"ContainerDied","Data":"7f1c669ffa064d81b08e8a086ac6ddae51d15937f3d217ef7c796c3a7e5b3d5e"}
Oct 29 23:27:29.105065 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.103867    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f1c669ffa064d81b08e8a086ac6ddae51d15937f3d217ef7c796c3a7e5b3d5e"
Oct 29 23:27:29.105065 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.103938    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-55d44ce2-sdtdw"
Oct 29 23:27:29.106489 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.106447    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" podUID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": dial tcp 10.132.0.74:8000: connect: connection refused"
Oct 29 23:27:29.106921 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.106895    5044 generic.go:356] "Generic (PLEG): container finished" podID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" containerID="d6f71cee04103eada1e4ac52f27688d4bd3601b7892488deb350994a88e75b3c" exitCode=0
Oct 29 23:27:29.107020 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.106998    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" event={"ID":"60065167-1bee-4ee5-9a43-7fb8666fc1d9","Type":"ContainerDied","Data":"d6f71cee04103eada1e4ac52f27688d4bd3601b7892488deb350994a88e75b3c"}
Oct 29 23:27:29.145347 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.145310    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:29.224814 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.224789    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:27:29.307937 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.307894    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:29.308142 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.307962    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.314624    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir\") pod \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") "
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.314821    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home\") pod \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") "
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.314897    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs\" (UniqueName: \"kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs\") pod \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") "
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.315068    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86\" (UniqueName: \"kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86\") pod \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") "
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.315288    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache\") pod \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") "
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.315370    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm\") pod \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\" (UID: \"60065167-1bee-4ee5-9a43-7fb8666fc1d9\") "
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.315833    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir" pod "60065167-1bee-4ee5-9a43-7fb8666fc1d9" (UID: "60065167-1bee-4ee5-9a43-7fb8666fc1d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.316069    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home" pod "60065167-1bee-4ee5-9a43-7fb8666fc1d9" (UID: "60065167-1bee-4ee5-9a43-7fb8666fc1d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.316279    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache" pod "60065167-1bee-4ee5-9a43-7fb8666fc1d9" (UID: "60065167-1bee-4ee5-9a43-7fb8666fc1d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.316291    5044 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tmp-dir\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.316313    5044 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-home\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:29.324797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.321436    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm" pod "60065167-1bee-4ee5-9a43-7fb8666fc1d9" (UID: "60065167-1bee-4ee5-9a43-7fb8666fc1d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:29.328795 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.328395    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs" pod "60065167-1bee-4ee5-9a43-7fb8666fc1d9" (UID: "60065167-1bee-4ee5-9a43-7fb8666fc1d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:29.329258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.329224    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86" pod "60065167-1bee-4ee5-9a43-7fb8666fc1d9" (UID: "60065167-1bee-4ee5-9a43-7fb8666fc1d9"). InnerVolumeSpecName "kube-api-access-g8d86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:29.403161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.403077    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:29.403161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.403145    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:29.417772 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.417745    5044 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-dshm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:29.417772 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.417770    5044 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60065167-1bee-4ee5-9a43-7fb8666fc1d9-tls-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:29.417959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.417779    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8d86\" (UniqueName: \"kubernetes.io/projected/60065167-1bee-4ee5-9a43-7fb8666fc1d9-kube-api-access-g8d86\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:29.417959 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.417789    5044 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60065167-1bee-4ee5-9a43-7fb8666fc1d9-model-cache\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:29.746671 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.746636    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:29.892576 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.892532    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"]
Oct 29 23:27:29.894018 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.893984    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:29.895175 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:29.895154    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w1-b2c5f2-dglbf"]
Oct 29 23:27:30.034590 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.034499    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:30.114951 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.114918    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"
Oct 29 23:27:30.115412 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.114958    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw" event={"ID":"60065167-1bee-4ee5-9a43-7fb8666fc1d9","Type":"ContainerDied","Data":"9035af7b6291f6f407e284d3a8319a498c857fcd4c4ecf3a16664e74b6e0b5fe"}
Oct 29 23:27:30.115412 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.115005    5044 scope.go:122] "RemoveContainer" containerID="d6f71cee04103eada1e4ac52f27688d4bd3601b7892488deb350994a88e75b3c"
Oct 29 23:27:30.190041 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.190002    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"]
Oct 29 23:27:30.193939 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.193918    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-b0153c/premium-w0-b0153c-kserve-b78dfdbd8-m4qpw"]
Oct 29 23:27:30.303032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.302951    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:30.303032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.303001    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:30.308561 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.308530    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:30.308749 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.308723    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:30.434348 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.434311    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:30.821824 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.821794    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" path="/var/lib/kubelet/pods/60065167-1bee-4ee5-9a43-7fb8666fc1d9/volumes"
Oct 29 23:27:30.822239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:30.822225    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79054173-3873-404f-98f6-c0776772728d" path="/var/lib/kubelet/pods/79054173-3873-404f-98f6-c0776772728d/volumes"
Oct 29 23:27:31.304043 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:31.304000    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:31.304451 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:31.304058    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:31.891502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:31.890137    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:32.302996 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:32.302957    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:32.303183 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:32.303012    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:33.304059 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:33.304024    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:33.304446 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:33.304080    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:33.722304 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:33.722265    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:34.302958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:34.302927    5044 patch_prober.go:29] interesting pod/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 29 23:27:34.303113 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:34.302987    5044 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 29 23:27:35.308265 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:35.308234    5044 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:35.308725 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:35.308702    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:35.309415 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:35.309396    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:27:35.711468 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:35.711389    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:35.866988 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:35.866948    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:36.790571 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:36.790536    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:36.936086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:36.936048    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:37.213228 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.213137    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:37.438752 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.438714    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:37.686729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.686370    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:27:37.729621 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.729597    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume\") pod \"4d069ec6-194c-4363-9d0c-82214e977dcf\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") "
Oct 29 23:27:37.729748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.729640    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b\" (UniqueName: \"kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b\") pod \"4d069ec6-194c-4363-9d0c-82214e977dcf\" (UID: \"4d069ec6-194c-4363-9d0c-82214e977dcf\") "
Oct 29 23:27:37.730322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.729976    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume" pod "4d069ec6-194c-4363-9d0c-82214e977dcf" (UID: "4d069ec6-194c-4363-9d0c-82214e977dcf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:37.730322 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.730290    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d069ec6-194c-4363-9d0c-82214e977dcf-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:37.731948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.731917    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b" pod "4d069ec6-194c-4363-9d0c-82214e977dcf" (UID: "4d069ec6-194c-4363-9d0c-82214e977dcf"). InnerVolumeSpecName "kube-api-access-wxp6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:37.737245 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.737189    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:27:37.862828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.831849    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9\" (UniqueName: \"kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9\") pod \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") "
Oct 29 23:27:37.862828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.832049    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume\") pod \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\" (UID: \"c91d3b5b-42a4-4fe0-b1ff-973876372fa2\") "
Oct 29 23:27:37.862828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.832500    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxp6b\" (UniqueName: \"kubernetes.io/projected/4d069ec6-194c-4363-9d0c-82214e977dcf-kube-api-access-wxp6b\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:37.862828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.852632    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9" pod "c91d3b5b-42a4-4fe0-b1ff-973876372fa2" (UID: "c91d3b5b-42a4-4fe0-b1ff-973876372fa2"). InnerVolumeSpecName "kube-api-access-trpr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:37.863944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.863860    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume" pod "c91d3b5b-42a4-4fe0-b1ff-973876372fa2" (UID: "c91d3b5b-42a4-4fe0-b1ff-973876372fa2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:37.922049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.922006    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:37.933219 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.933192    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trpr9\" (UniqueName: \"kubernetes.io/projected/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-kube-api-access-trpr9\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:37.933219 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:37.933218    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c91d3b5b-42a4-4fe0-b1ff-973876372fa2-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:38.090580 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.083526    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:38.168503 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.168444    5044 generic.go:356] "Generic (PLEG): container finished" podID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerID="f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f" exitCode=0
Oct 29 23:27:38.168695 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.168541    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"
Oct 29 23:27:38.168695 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.168535    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" event={"ID":"c91d3b5b-42a4-4fe0-b1ff-973876372fa2","Type":"ContainerDied","Data":"f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f"}
Oct 29 23:27:38.168822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.168692    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2" event={"ID":"c91d3b5b-42a4-4fe0-b1ff-973876372fa2","Type":"ContainerDied","Data":"fdb4112c724faff7e1d73d8a484253976b7ab19aa914f7d09ef49d7071907ed5"}
Oct 29 23:27:38.168822 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.168759    5044 scope.go:122] "RemoveContainer" containerID="f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f"
Oct 29 23:27:38.170366 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.170343    5044 generic.go:356] "Generic (PLEG): container finished" podID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerID="36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39" exitCode=0
Oct 29 23:27:38.170507 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.170449    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" event={"ID":"4d069ec6-194c-4363-9d0c-82214e977dcf","Type":"ContainerDied","Data":"36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39"}
Oct 29 23:27:38.170562 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.170530    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m" event={"ID":"4d069ec6-194c-4363-9d0c-82214e977dcf","Type":"ContainerDied","Data":"ea14708e682e3531fbbdf2434859410a9e7b4fca6781d3ebfcb5200d1cce0f28"}
Oct 29 23:27:38.170619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.170605    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"
Oct 29 23:27:38.182805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.182759    5044 scope.go:122] "RemoveContainer" containerID="f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f"
Oct 29 23:27:38.183108 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:38.183080    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f\": container with ID starting with f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f not found: ID does not exist" containerID="f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f"
Oct 29 23:27:38.183192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.183118    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f"} err="failed to get container status \"f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f\": rpc error: code = NotFound desc = could not find container \"f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f\": container with ID starting with f08f5a7dc9c2d5471b222d382e0131980b63323a81f85de4f9a3678dc43aac7f not found: ID does not exist"
Oct 29 23:27:38.183192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.183140    5044 scope.go:122] "RemoveContainer" containerID="36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39"
Oct 29 23:27:38.184252 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.184210    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"]
Oct 29 23:27:38.187650 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.187627    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-105882-4tn9f"]
Oct 29 23:27:38.194086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.194042    5044 scope.go:122] "RemoveContainer" containerID="36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39"
Oct 29 23:27:38.194384 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:38.194363    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39\": container with ID starting with 36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39 not found: ID does not exist" containerID="36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39"
Oct 29 23:27:38.194488 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.194391    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39"} err="failed to get container status \"36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39\": rpc error: code = NotFound desc = could not find container \"36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39\": container with ID starting with 36e3bfd2b4726bde1fab9acaa5d12bd5ef76318b8147fc9584f7889a885f7a39 not found: ID does not exist"
Oct 29 23:27:38.231932 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.231899    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"]
Oct 29 23:27:38.259996 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.243146    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-b2c5f2-595d9dd65b-7xp2m"]
Oct 29 23:27:38.269733 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.269667    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:38.322438 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.316363    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"]
Oct 29 23:27:38.322438 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.322003    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w1-b2c5f2-cbcf95b55-mtlv2"]
Oct 29 23:27:38.722233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.722131    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:38.820949 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.820917    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="012b5128-77d5-453e-a594-19af2aa19acf" path="/var/lib/kubelet/pods/012b5128-77d5-453e-a594-19af2aa19acf/volumes"
Oct 29 23:27:38.821328 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.821314    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" path="/var/lib/kubelet/pods/4d069ec6-194c-4363-9d0c-82214e977dcf/volumes"
Oct 29 23:27:38.821732 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.821713    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" path="/var/lib/kubelet/pods/c91d3b5b-42a4-4fe0-b1ff-973876372fa2/volumes"
Oct 29 23:27:38.882156 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.882117    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:38.955399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955367    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"]
Oct 29 23:27:38.955900 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955881    5044 cpu_manager.go:414] "containerMap: removing container" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerName="payload-pre-processing"
Oct 29 23:27:38.955982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955902    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerName="payload-pre-processing"
Oct 29 23:27:38.955982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955922    5044 cpu_manager.go:414] "containerMap: removing container" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerName="payload-processing"
Oct 29 23:27:38.955982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955929    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerName="payload-processing"
Oct 29 23:27:38.955982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955957    5044 cpu_manager.go:414] "containerMap: removing container" podUID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" containerName="main"
Oct 29 23:27:38.955982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955965    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" containerName="main"
Oct 29 23:27:38.956133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955986    5044 cpu_manager.go:414] "containerMap: removing container" podUID="1438130c-5bd5-49ee-ab63-43628e2346ff" containerName="revoke-keys"
Oct 29 23:27:38.956133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.955993    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1438130c-5bd5-49ee-ab63-43628e2346ff" containerName="revoke-keys"
Oct 29 23:27:38.956133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956020    5044 cpu_manager.go:414] "containerMap: removing container" podUID="e8383cab-0805-42ba-b08c-d2edd8e5b056" containerName="revoke-keys"
Oct 29 23:27:38.956133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956027    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8383cab-0805-42ba-b08c-d2edd8e5b056" containerName="revoke-keys"
Oct 29 23:27:38.956133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956123    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="1438130c-5bd5-49ee-ab63-43628e2346ff" containerName="revoke-keys"
Oct 29 23:27:38.956267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956135    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8383cab-0805-42ba-b08c-d2edd8e5b056" containerName="revoke-keys"
Oct 29 23:27:38.956267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956143    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="c91d3b5b-42a4-4fe0-b1ff-973876372fa2" containerName="payload-pre-processing"
Oct 29 23:27:38.956267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956149    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="4d069ec6-194c-4363-9d0c-82214e977dcf" containerName="payload-processing"
Oct 29 23:27:38.956267 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.956158    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="60065167-1bee-4ee5-9a43-7fb8666fc1d9" containerName="main"
Oct 29 23:27:38.960733 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.960714    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:38.979867 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.979801    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:38.979867 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.979857    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:38.980032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.979897    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:38.980738 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.980715    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"]
Oct 29 23:27:38.988548 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:38.988529    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:39.044545 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.044513    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.044704 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.044605    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.044704 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.044684    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx7tk\" (UniqueName: \"kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.146278 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.146241    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.146472 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.146302    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx7tk\" (UniqueName: \"kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.146472 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.146460    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.147099 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.147064    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.148624 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.148604    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.164331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.164307    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx7tk\" (UniqueName: \"kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk\") pod \"maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.275038 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.274963    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:39.341859 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.341653    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:39.573540 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:39.573510    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"]
Oct 29 23:27:39.574895 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:39.574864    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23bfc32e_8446_4390_bbc1_23d98de6c2d4.slice/crio-382e489fd7f47b391431ad681bef54dc6e89a8c16d0731d66efcbff0ae091098 WatchSource:0}: Error finding container 382e489fd7f47b391431ad681bef54dc6e89a8c16d0731d66efcbff0ae091098: Status 404 returned error can't find the container with id 382e489fd7f47b391431ad681bef54dc6e89a8c16d0731d66efcbff0ae091098
Oct 29 23:27:40.188440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:40.188347    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt" event={"ID":"23bfc32e-8446-4390-bbc1-23d98de6c2d4","Type":"ContainerStarted","Data":"7cbfb5cb40334d7ad2fdeb3c0c84a2e6e45db200770e2dc1e21d367dcc6d70b6"}
Oct 29 23:27:40.188440 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:40.188403    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt" event={"ID":"23bfc32e-8446-4390-bbc1-23d98de6c2d4","Type":"ContainerStarted","Data":"382e489fd7f47b391431ad681bef54dc6e89a8c16d0731d66efcbff0ae091098"}
Oct 29 23:27:40.229092 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:40.229033    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt" podStartSLOduration=2.22901704 podStartE2EDuration="2.22901704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:40.226676724 +0000 UTC m=+871.537921049" watchObservedRunningTime="2026-10-29 23:27:40.22901704 +0000 UTC m=+871.540261382"
Oct 29 23:27:40.307927 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:40.307894    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:40.308077 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:40.307895    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:27:40.528256 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:40.528219    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:27:40.687188 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:40.687139    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:41.198007 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:41.197974    5044 generic.go:356] "Generic (PLEG): container finished" podID="23bfc32e-8446-4390-bbc1-23d98de6c2d4" containerID="7cbfb5cb40334d7ad2fdeb3c0c84a2e6e45db200770e2dc1e21d367dcc6d70b6" exitCode=0
Oct 29 23:27:41.198648 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:41.198026    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt" event={"ID":"23bfc32e-8446-4390-bbc1-23d98de6c2d4","Type":"ContainerDied","Data":"7cbfb5cb40334d7ad2fdeb3c0c84a2e6e45db200770e2dc1e21d367dcc6d70b6"}
Oct 29 23:27:42.354192 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.354161    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:42.466858 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.466756    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:42.486230 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.486187    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk\" (UniqueName: \"kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk\") pod \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") "
Oct 29 23:27:42.486560 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.486459    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca\") pod \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") "
Oct 29 23:27:42.487636 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.486598    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca\") pod \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\" (UID: \"23bfc32e-8446-4390-bbc1-23d98de6c2d4\") "
Oct 29 23:27:42.487636 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.487442    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca" pod "23bfc32e-8446-4390-bbc1-23d98de6c2d4" (UID: "23bfc32e-8446-4390-bbc1-23d98de6c2d4"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:42.490759 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.490703    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk" pod "23bfc32e-8446-4390-bbc1-23d98de6c2d4" (UID: "23bfc32e-8446-4390-bbc1-23d98de6c2d4"). InnerVolumeSpecName "kube-api-access-bx7tk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:42.491338 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.491308    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca" pod "23bfc32e-8446-4390-bbc1-23d98de6c2d4" (UID: "23bfc32e-8446-4390-bbc1-23d98de6c2d4"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:42.588080 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.588045    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:42.588080 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.588076    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx7tk\" (UniqueName: \"kubernetes.io/projected/23bfc32e-8446-4390-bbc1-23d98de6c2d4-kube-api-access-bx7tk\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:42.588080 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:42.588086    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/23bfc32e-8446-4390-bbc1-23d98de6c2d4-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:43.210748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.210671    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"
Oct 29 23:27:43.210748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.210703    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt" event={"ID":"23bfc32e-8446-4390-bbc1-23d98de6c2d4","Type":"ContainerDied","Data":"382e489fd7f47b391431ad681bef54dc6e89a8c16d0731d66efcbff0ae091098"}
Oct 29 23:27:43.210939 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.210751    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="382e489fd7f47b391431ad681bef54dc6e89a8c16d0731d66efcbff0ae091098"
Oct 29 23:27:43.645013 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.644979    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"]
Oct 29 23:27:43.656316 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.656285    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"]
Oct 29 23:27:43.826101 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.826067    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:43.980879 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:43.980841    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:44.131548 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.131471    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:44.313626 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.313536    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:44.318813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.318786    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"]
Oct 29 23:27:44.319300 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.319286    5044 cpu_manager.go:414] "containerMap: removing container" podUID="23bfc32e-8446-4390-bbc1-23d98de6c2d4" containerName="revoke-keys"
Oct 29 23:27:44.319352 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.319301    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23bfc32e-8446-4390-bbc1-23d98de6c2d4" containerName="revoke-keys"
Oct 29 23:27:44.319407 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.319398    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="23bfc32e-8446-4390-bbc1-23d98de6c2d4" containerName="revoke-keys"
Oct 29 23:27:44.323125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.323106    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.341930 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.341905    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:44.345378 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.345355    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"]
Oct 29 23:27:44.352950 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.352927    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:44.353072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.352960    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:44.353072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.353052    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:44.407000 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.406969    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.407234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.407035    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.407352 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.407231    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbcbj\" (UniqueName: \"kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.508725 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.508681    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbcbj\" (UniqueName: \"kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.508944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.508781    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.508944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.508829    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.509456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.509432    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.511179 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.511159    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.531098 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.527429    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:44.532466 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.532430    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbcbj\" (UniqueName: \"kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj\") pod \"maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.636706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.636626    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:44.836519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.836139    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:44.937394 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.936854    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"]
Oct 29 23:27:44.938793 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:44.938757    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c616e0f_b9a4_487d_b266_2ab24f618f01.slice/crio-006926dc59257d7db37a2a207541fc66a2ada1f4bbec55872c4103c502cdd286 WatchSource:0}: Error finding container 006926dc59257d7db37a2a207541fc66a2ada1f4bbec55872c4103c502cdd286: Status 404 returned error can't find the container with id 006926dc59257d7db37a2a207541fc66a2ada1f4bbec55872c4103c502cdd286
Oct 29 23:27:44.939003 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.938985    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:27:44.978942 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:44.978917    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:27:45.014967 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.014933    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf\" (UniqueName: \"kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf\") pod \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") "
Oct 29 23:27:45.015123 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.014970    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume\") pod \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\" (UID: \"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365\") "
Oct 29 23:27:45.015489 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.015448    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume" pod "c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" (UID: "c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:45.017073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.017052    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf" pod "c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" (UID: "c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365"). InnerVolumeSpecName "kube-api-access-297hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:45.116888 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.116852    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume\") pod \"3461cb13-23de-4a58-9b32-022c9c65aa6b\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") "
Oct 29 23:27:45.117059 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.116903    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc\" (UniqueName: \"kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc\") pod \"3461cb13-23de-4a58-9b32-022c9c65aa6b\" (UID: \"3461cb13-23de-4a58-9b32-022c9c65aa6b\") "
Oct 29 23:27:45.117390 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.117365    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume" pod "3461cb13-23de-4a58-9b32-022c9c65aa6b" (UID: "3461cb13-23de-4a58-9b32-022c9c65aa6b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:45.117390 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.117380    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:45.117531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.117400    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-297hf\" (UniqueName: \"kubernetes.io/projected/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365-kube-api-access-297hf\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:45.119032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.119009    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc" pod "3461cb13-23de-4a58-9b32-022c9c65aa6b" (UID: "3461cb13-23de-4a58-9b32-022c9c65aa6b"). InnerVolumeSpecName "kube-api-access-k6mgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:45.218949 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.218917    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3461cb13-23de-4a58-9b32-022c9c65aa6b-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:45.218949 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.218944    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6mgc\" (UniqueName: \"kubernetes.io/projected/3461cb13-23de-4a58-9b32-022c9c65aa6b-kube-api-access-k6mgc\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:45.224964 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.224932    5044 generic.go:356] "Generic (PLEG): container finished" podID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerID="f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359" exitCode=0
Oct 29 23:27:45.225085 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.224980    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"
Oct 29 23:27:45.225085 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.225010    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" event={"ID":"3461cb13-23de-4a58-9b32-022c9c65aa6b","Type":"ContainerDied","Data":"f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359"}
Oct 29 23:27:45.225085 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.225061    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq" event={"ID":"3461cb13-23de-4a58-9b32-022c9c65aa6b","Type":"ContainerDied","Data":"97f63c13307c5eea2f4b49d53190938b2c6ce2e4f1938159de8608dd75bac2d0"}
Oct 29 23:27:45.225218 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.225088    5044 scope.go:122] "RemoveContainer" containerID="f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359"
Oct 29 23:27:45.227133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.227110    5044 generic.go:356] "Generic (PLEG): container finished" podID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerID="a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38" exitCode=0
Oct 29 23:27:45.227235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.227162    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"
Oct 29 23:27:45.227235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.227175    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" event={"ID":"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365","Type":"ContainerDied","Data":"a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38"}
Oct 29 23:27:45.227235 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.227229    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2" event={"ID":"c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365","Type":"ContainerDied","Data":"ae84dd8675b0fc776892d8df73cb2181749c076ea0f643387037588043157415"}
Oct 29 23:27:45.238360 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.238254    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x" event={"ID":"4c616e0f-b9a4-487d-b266-2ab24f618f01","Type":"ContainerStarted","Data":"006926dc59257d7db37a2a207541fc66a2ada1f4bbec55872c4103c502cdd286"}
Oct 29 23:27:45.245110 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.245090    5044 scope.go:122] "RemoveContainer" containerID="f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359"
Oct 29 23:27:45.245422 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:45.245395    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359\": container with ID starting with f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359 not found: ID does not exist" containerID="f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359"
Oct 29 23:27:45.245531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.245432    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359"} err="failed to get container status \"f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359\": rpc error: code = NotFound desc = could not find container \"f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359\": container with ID starting with f71819f019ce307c7a349332001bee11ec2975f5f0b0a90933c263addb170359 not found: ID does not exist"
Oct 29 23:27:45.245531 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.245455    5044 scope.go:122] "RemoveContainer" containerID="a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38"
Oct 29 23:27:45.254095 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.254078    5044 scope.go:122] "RemoveContainer" containerID="a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38"
Oct 29 23:27:45.254368 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:45.254350    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38\": container with ID starting with a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38 not found: ID does not exist" containerID="a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38"
Oct 29 23:27:45.254428 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.254374    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38"} err="failed to get container status \"a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38\": rpc error: code = NotFound desc = could not find container \"a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38\": container with ID starting with a2dce9489caf2919261bced0d23373b2af50c3b11eb0b8274f5fae994ca5da38 not found: ID does not exist"
Oct 29 23:27:45.288081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.288052    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"]
Oct 29 23:27:45.292631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.292607    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-b0153c-685f85966c-wwntq"]
Oct 29 23:27:45.325943 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.325913    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"]
Oct 29 23:27:45.330433 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:45.330407    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-b0153c-5d58b7589d-2f4h2"]
Oct 29 23:27:46.246928 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:46.246896    5044 generic.go:356] "Generic (PLEG): container finished" podID="4c616e0f-b9a4-487d-b266-2ab24f618f01" containerID="12de5a9b78f482ec0074d45811e3bdcb07f564220492e63f8f2cee9f0cd0a900" exitCode=0
Oct 29 23:27:46.247385 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:46.246938    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x" event={"ID":"4c616e0f-b9a4-487d-b266-2ab24f618f01","Type":"ContainerDied","Data":"12de5a9b78f482ec0074d45811e3bdcb07f564220492e63f8f2cee9f0cd0a900"}
Oct 29 23:27:46.635424 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:46.635331    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:46.820207 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:46.820178    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" path="/var/lib/kubelet/pods/3461cb13-23de-4a58-9b32-022c9c65aa6b/volumes"
Oct 29 23:27:46.820625 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:46.820611    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" path="/var/lib/kubelet/pods/c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365/volumes"
Oct 29 23:27:47.407156 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.407134    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:47.476791 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.476755    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:47.545901 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.545831    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca\") pod \"4c616e0f-b9a4-487d-b266-2ab24f618f01\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") "
Oct 29 23:27:47.546058 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.545987    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj\" (UniqueName: \"kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj\") pod \"4c616e0f-b9a4-487d-b266-2ab24f618f01\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") "
Oct 29 23:27:47.546058 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.546013    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca\") pod \"4c616e0f-b9a4-487d-b266-2ab24f618f01\" (UID: \"4c616e0f-b9a4-487d-b266-2ab24f618f01\") "
Oct 29 23:27:47.546421 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.546392    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca" pod "4c616e0f-b9a4-487d-b266-2ab24f618f01" (UID: "4c616e0f-b9a4-487d-b266-2ab24f618f01"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:47.547888 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.547861    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca" pod "4c616e0f-b9a4-487d-b266-2ab24f618f01" (UID: "4c616e0f-b9a4-487d-b266-2ab24f618f01"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:47.548107 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.548092    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj" pod "4c616e0f-b9a4-487d-b266-2ab24f618f01" (UID: "4c616e0f-b9a4-487d-b266-2ab24f618f01"). InnerVolumeSpecName "kube-api-access-vbcbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:47.640225 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.640189    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:47.647864 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.647836    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbcbj\" (UniqueName: \"kubernetes.io/projected/4c616e0f-b9a4-487d-b266-2ab24f618f01-kube-api-access-vbcbj\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:47.647864 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.647861    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:47.648081 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.647873    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4c616e0f-b9a4-487d-b266-2ab24f618f01-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:47.764970 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.760927    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"]
Oct 29 23:27:47.764970 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.761201    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" containerID="cri-o://86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a" gracePeriod=30
Oct 29 23:27:47.799436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.799352    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:47.929502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.921198    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"]
Oct 29 23:27:47.929502 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.921439    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" containerID="cri-o://5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5" gracePeriod=30
Oct 29 23:27:47.959692 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:47.959654    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:48.121594 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.117295    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:48.247548 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.247502    5044 patch_prober.go:29] interesting pod/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 29 23:27:48.247704 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.247568    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:27:48.260609 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.260580    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"
Oct 29 23:27:48.260765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.260606    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x" event={"ID":"4c616e0f-b9a4-487d-b266-2ab24f618f01","Type":"ContainerDied","Data":"006926dc59257d7db37a2a207541fc66a2ada1f4bbec55872c4103c502cdd286"}
Oct 29 23:27:48.260765 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.260664    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="006926dc59257d7db37a2a207541fc66a2ada1f4bbec55872c4103c502cdd286"
Oct 29 23:27:48.563145 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:48.563115    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:49.006299 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:49.006265    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"]
Oct 29 23:27:49.186010 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:49.185977    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:49.613532 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:49.613497    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:49.841522 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:49.841466    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:50.067861 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:50.067827    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:50.295641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:50.295582    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:50.689995 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:50.689965    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:50.928702 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:50.928665    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:51.666328 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.666283    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:51.897880 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.897847    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"]
Oct 29 23:27:51.898633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898614    5044 cpu_manager.go:414] "containerMap: removing container" podUID="4c616e0f-b9a4-487d-b266-2ab24f618f01" containerName="revoke-keys"
Oct 29 23:27:51.898685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898636    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4c616e0f-b9a4-487d-b266-2ab24f618f01" containerName="revoke-keys"
Oct 29 23:27:51.898685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898658    5044 cpu_manager.go:414] "containerMap: removing container" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerName="payload-processing"
Oct 29 23:27:51.898685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898666    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerName="payload-processing"
Oct 29 23:27:51.898685 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898676    5044 cpu_manager.go:414] "containerMap: removing container" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerName="payload-pre-processing"
Oct 29 23:27:51.898810 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898684    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerName="payload-pre-processing"
Oct 29 23:27:51.898846 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898813    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="4c616e0f-b9a4-487d-b266-2ab24f618f01" containerName="revoke-keys"
Oct 29 23:27:51.898846 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898828    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="c50f1e1e-c1f5-4a25-b56a-4ef55b3f7365" containerName="payload-processing"
Oct 29 23:27:51.898846 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.898839    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="3461cb13-23de-4a58-9b32-022c9c65aa6b" containerName="payload-pre-processing"
Oct 29 23:27:51.903063 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.903041    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:51.922875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.922803    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"]
Oct 29 23:27:51.931016 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.930995    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:51.931016 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.931014    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:51.931185 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.931061    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:51.932399 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:51.932373    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:52.001674 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.001633    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.001853 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.001683    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.001928 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.001919    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87g5n\" (UniqueName: \"kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.009596 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.009558    5044 patch_prober.go:29] interesting pod/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 29 23:27:52.009745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.009627    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 29 23:27:52.103202 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.103170    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.103404 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.103385    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87g5n\" (UniqueName: \"kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.103455 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.103437    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.104108 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.104086    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.105615 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.105593    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.121711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.121691    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87g5n\" (UniqueName: \"kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n\") pod \"maas-api-revoke-sub-bb4401dc-xnvsm\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.219436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.219269    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:52.311102 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.311055    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:52.445978 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.445943    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:52.512809 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:52.512784    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"]
Oct 29 23:27:52.513944 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:52.513920    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8290442_8829_4560_9859_2724ae65a54f.slice/crio-4aac60b873d83841aeadcdf65eff025c46cec43e3e540f1d3031084f1ebc7169 WatchSource:0}: Error finding container 4aac60b873d83841aeadcdf65eff025c46cec43e3e540f1d3031084f1ebc7169: Status 404 returned error can't find the container with id 4aac60b873d83841aeadcdf65eff025c46cec43e3e540f1d3031084f1ebc7169
Oct 29 23:27:53.040281 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.040253    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:27:53.117788 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.117760    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.117947 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.117856    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.117947 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.117917    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118077 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.117948    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118077 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118014    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118077 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118041    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118077 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118059    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.118284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118078    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118118    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118284 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118182    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs\") pod \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\" (UID: \"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396\") "
Oct 29 23:27:53.118513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118396    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:53.118706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118686    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.118777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118691    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.118777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118737    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.118891 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118835    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.118948 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.118913    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.121609 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.121473    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:53.121676 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.121609    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:27:53.121917 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.121876    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.121917 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.121872    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql" pod "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" (UID: "cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396"). InnerVolumeSpecName "kube-api-access-2s9ql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:53.210022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.209994    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:27:53.220151 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220129    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.220151 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220151    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.220287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220160    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.220287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220170    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.220287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220179    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.220287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220186    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.220287 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.220194    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2s9ql\" (UniqueName: \"kubernetes.io/projected/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396-kube-api-access-2s9ql\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.294766 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.294689    5044 generic.go:356] "Generic (PLEG): container finished" podID="d27d7164-13e0-449d-b22c-2043b844b88a" containerID="5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5" exitCode=0
Oct 29 23:27:53.294766 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.294741    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"
Oct 29 23:27:53.295057 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.294772    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" event={"ID":"d27d7164-13e0-449d-b22c-2043b844b88a","Type":"ContainerDied","Data":"5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5"}
Oct 29 23:27:53.295057 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.294853    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f" event={"ID":"d27d7164-13e0-449d-b22c-2043b844b88a","Type":"ContainerDied","Data":"7c9eb5d114fd51171af8b5241d6e7defd071672da70a460a821e4cc5b10006ea"}
Oct 29 23:27:53.295057 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.294882    5044 scope.go:122] "RemoveContainer" containerID="5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5"
Oct 29 23:27:53.296725 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.296510    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm" event={"ID":"b8290442-8829-4560-9859-2724ae65a54f","Type":"ContainerStarted","Data":"f8e956e757ddf50e8c28e82ccab87c9656d5f1c860ea09dbddec0468d36dcadc"}
Oct 29 23:27:53.296725 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.296552    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm" event={"ID":"b8290442-8829-4560-9859-2724ae65a54f","Type":"ContainerStarted","Data":"4aac60b873d83841aeadcdf65eff025c46cec43e3e540f1d3031084f1ebc7169"}
Oct 29 23:27:53.297818 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.297796    5044 generic.go:356] "Generic (PLEG): container finished" podID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerID="86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a" exitCode=0
Oct 29 23:27:53.297895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.297828    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"
Oct 29 23:27:53.297895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.297835    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" event={"ID":"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396","Type":"ContainerDied","Data":"86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a"}
Oct 29 23:27:53.297895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.297865    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b" event={"ID":"cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396","Type":"ContainerDied","Data":"444411200d877206f8791d01f66396013c4d6885c3d64971b36b523d756fd4ac"}
Oct 29 23:27:53.305358 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.305337    5044 scope.go:122] "RemoveContainer" containerID="0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"
Oct 29 23:27:53.314239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.314221    5044 scope.go:122] "RemoveContainer" containerID="5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5"
Oct 29 23:27:53.314472 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:53.314454    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5\": container with ID starting with 5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5 not found: ID does not exist" containerID="5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5"
Oct 29 23:27:53.314597 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.314578    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5"} err="failed to get container status \"5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5\": rpc error: code = NotFound desc = could not find container \"5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5\": container with ID starting with 5943ba9f74e8c177f5918eff4cf427dbafec0bf1b0f79f92bfe2bc276840acc5 not found: ID does not exist"
Oct 29 23:27:53.314645 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.314598    5044 scope.go:122] "RemoveContainer" containerID="0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"
Oct 29 23:27:53.314807 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:53.314792    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de\": container with ID starting with 0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de not found: ID does not exist" containerID="0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"
Oct 29 23:27:53.314860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.314811    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de"} err="failed to get container status \"0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de\": rpc error: code = NotFound desc = could not find container \"0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de\": container with ID starting with 0d46e2a0e64a32fe627c6f2a83293b03a32be3bef595c6135f5535ec3bcf28de not found: ID does not exist"
Oct 29 23:27:53.314860 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.314822    5044 scope.go:122] "RemoveContainer" containerID="86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a"
Oct 29 23:27:53.320935 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.320910    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.320949    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321109 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321091    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321152    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321186    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321203 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321191    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.321277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321222    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321263    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321290    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321374 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321335    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket\") pod \"d27d7164-13e0-449d-b22c-2043b844b88a\" (UID: \"d27d7164-13e0-449d-b22c-2043b844b88a\") "
Oct 29 23:27:53.321498 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321364    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.321498 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321435    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.321681 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321659    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.321803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321776    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.321896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321811    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.321896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321826    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.321896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321841    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.321896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.321778    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:53.323971 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.323952    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:27:53.324028 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.323965    5044 scope.go:122] "RemoveContainer" containerID="86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a"
Oct 29 23:27:53.324028 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.323969    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "kube-api-access-dq2sq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:53.324253 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:53.324235    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a\": container with ID starting with 86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a not found: ID does not exist" containerID="86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a"
Oct 29 23:27:53.324293 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.324260    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a"} err="failed to get container status \"86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a\": rpc error: code = NotFound desc = could not find container \"86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a\": container with ID starting with 86ad416e4df98343d9bc3121f0751b18888b8cf62ae6df8cc87f60f15a6bee8a not found: ID does not exist"
Oct 29 23:27:53.338767 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.338745    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:53.344340 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.344318    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"]
Oct 29 23:27:53.346895 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.346874    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token" pod "d27d7164-13e0-449d-b22c-2043b844b88a" (UID: "d27d7164-13e0-449d-b22c-2043b844b88a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:53.348918 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.348898    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-105882-openshift-default-58cf59579-vvf6b"]
Oct 29 23:27:53.381071 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.381029    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm" podStartSLOduration=2.381016049 podStartE2EDuration="2.381016049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:27:53.380208876 +0000 UTC m=+884.691453212" watchObservedRunningTime="2026-10-29 23:27:53.381016049 +0000 UTC m=+884.692260373"
Oct 29 23:27:53.423138 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.423100    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d27d7164-13e0-449d-b22c-2043b844b88a-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.423138 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.423135    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dq2sq\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-kube-api-access-dq2sq\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.423368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.423152    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d27d7164-13e0-449d-b22c-2043b844b88a-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.423368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.423165    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d27d7164-13e0-449d-b22c-2043b844b88a-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.423368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.423178    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d27d7164-13e0-449d-b22c-2043b844b88a-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:53.639556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.639517    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"]
Oct 29 23:27:53.650167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:53.650142    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-b0153c-openshift-default-59786cf49-rkq7f"]
Oct 29 23:27:54.168540 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.168500    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:54.306054 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.306022    5044 generic.go:356] "Generic (PLEG): container finished" podID="b8290442-8829-4560-9859-2724ae65a54f" containerID="f8e956e757ddf50e8c28e82ccab87c9656d5f1c860ea09dbddec0468d36dcadc" exitCode=0
Oct 29 23:27:54.306217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.306113    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm" event={"ID":"b8290442-8829-4560-9859-2724ae65a54f","Type":"ContainerDied","Data":"f8e956e757ddf50e8c28e82ccab87c9656d5f1c860ea09dbddec0468d36dcadc"}
Oct 29 23:27:54.780001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.779965    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"]
Oct 29 23:27:54.821698 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.821669    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" path="/var/lib/kubelet/pods/cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396/volumes"
Oct 29 23:27:54.822152 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.822139    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" path="/var/lib/kubelet/pods/d27d7164-13e0-449d-b22c-2043b844b88a/volumes"
Oct 29 23:27:54.983304 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:54.983197    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:55.133914 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.133822    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:55.142881 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.142852    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"]
Oct 29 23:27:55.143060 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.143041    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy" containerID="cri-o://bb64d925895a1ebd3191aaf7bfe0e7751b4bf8194ec190bbc509adaaadeddc46" gracePeriod=30
Oct 29 23:27:55.483140 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.483114    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:55.546010 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.545972    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca\") pod \"b8290442-8829-4560-9859-2724ae65a54f\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") "
Oct 29 23:27:55.546186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.546055    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n\" (UniqueName: \"kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n\") pod \"b8290442-8829-4560-9859-2724ae65a54f\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") "
Oct 29 23:27:55.546186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.546165    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca\") pod \"b8290442-8829-4560-9859-2724ae65a54f\" (UID: \"b8290442-8829-4560-9859-2724ae65a54f\") "
Oct 29 23:27:55.546552 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.546518    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca" pod "b8290442-8829-4560-9859-2724ae65a54f" (UID: "b8290442-8829-4560-9859-2724ae65a54f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:27:55.546673 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.546650    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b8290442-8829-4560-9859-2724ae65a54f-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:55.548231 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.548203    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n" pod "b8290442-8829-4560-9859-2724ae65a54f" (UID: "b8290442-8829-4560-9859-2724ae65a54f"). InnerVolumeSpecName "kube-api-access-87g5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:55.548387 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.548366    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca" pod "b8290442-8829-4560-9859-2724ae65a54f" (UID: "b8290442-8829-4560-9859-2724ae65a54f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:55.647735 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.647649    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b8290442-8829-4560-9859-2724ae65a54f-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:55.647735 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.647678    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87g5n\" (UniqueName: \"kubernetes.io/projected/b8290442-8829-4560-9859-2724ae65a54f-kube-api-access-87g5n\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:55.804719 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:55.804683    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:56.320375 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:56.320346    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm"
Oct 29 23:27:56.320564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:56.320387    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-bb4401dc-xnvsm" event={"ID":"b8290442-8829-4560-9859-2724ae65a54f","Type":"ContainerDied","Data":"4aac60b873d83841aeadcdf65eff025c46cec43e3e540f1d3031084f1ebc7169"}
Oct 29 23:27:56.320564 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:56.320435    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aac60b873d83841aeadcdf65eff025c46cec43e3e540f1d3031084f1ebc7169"
Oct 29 23:27:56.831712 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:56.831675    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:57.494875 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.494839    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"]
Oct 29 23:27:57.495323 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495310    5044 cpu_manager.go:414] "containerMap: removing container" podUID="b8290442-8829-4560-9859-2724ae65a54f" containerName="revoke-keys"
Oct 29 23:27:57.495382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495325    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b8290442-8829-4560-9859-2724ae65a54f" containerName="revoke-keys"
Oct 29 23:27:57.495382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495349    5044 cpu_manager.go:414] "containerMap: removing container" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy"
Oct 29 23:27:57.495382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495357    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy"
Oct 29 23:27:57.495382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495369    5044 cpu_manager.go:414] "containerMap: removing container" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy"
Oct 29 23:27:57.495382 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495374    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy"
Oct 29 23:27:57.495559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495392    5044 cpu_manager.go:414] "containerMap: removing container" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy"
Oct 29 23:27:57.495559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495397    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy"
Oct 29 23:27:57.495559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495472    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="b8290442-8829-4560-9859-2724ae65a54f" containerName="revoke-keys"
Oct 29 23:27:57.495559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495494    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy"
Oct 29 23:27:57.495559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495503    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="d27d7164-13e0-449d-b22c-2043b844b88a" containerName="istio-proxy"
Oct 29 23:27:57.495559 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.495516    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="cc5d42d2-e0ae-4be1-8a14-1c3a86fe2396" containerName="istio-proxy"
Oct 29 23:27:57.499104 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.499086    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.518422 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.518390    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"]
Oct 29 23:27:57.529508 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.526377    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 29 23:27:57.529508 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.526384    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 29 23:27:57.554009 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.553984    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 29 23:27:57.554168 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.554070    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7b6b\""
Oct 29 23:27:57.566609 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.566584    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.566754 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.566650    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczln\" (UniqueName: \"kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.566754 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.566740    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.668229 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.668193    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.668415 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.668270    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczln\" (UniqueName: \"kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.668415 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.668352    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.668989 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.668961    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.670515 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.670491    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.687387 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.687360    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczln\" (UniqueName: \"kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln\") pod \"maas-api-revoke-sub-34040f67-drxvx\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:57.812002 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:57.811928    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:27:58.105189 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.105158    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"]
Oct 29 23:27:58.107622 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:27:58.107591    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074d9f4b_8b18_4fa1_8000_9054b7e48116.slice/crio-3f97742bf9ae7efc21dadf51fa592b55e01407607bafb33dbc7f876f63953d62 WatchSource:0}: Error finding container 3f97742bf9ae7efc21dadf51fa592b55e01407607bafb33dbc7f876f63953d62: Status 404 returned error can't find the container with id 3f97742bf9ae7efc21dadf51fa592b55e01407607bafb33dbc7f876f63953d62
Oct 29 23:27:58.334546 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.334510    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx" event={"ID":"074d9f4b-8b18-4fa1-8000-9054b7e48116","Type":"ContainerStarted","Data":"3f97742bf9ae7efc21dadf51fa592b55e01407607bafb33dbc7f876f63953d62"}
Oct 29 23:27:58.666556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.666436    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp" podUID="1056ff58-0daa-4e25-a809-15d4d3cfa15b" containerName="main" containerID="cri-o://b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c" gracePeriod=45
Oct 29 23:27:58.676424 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.676386    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" podUID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" containerName="main" containerID="cri-o://b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618" gracePeriod=45
Oct 29 23:27:58.778964 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.778930    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" podUID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": dial tcp 10.132.0.71:8000: connect: connection refused"
Oct 29 23:27:58.952000 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.951977    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:27:58.955286 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:58.955258    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:27:59.065407 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.065307    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:59.085162 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085133    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs\" (UniqueName: \"kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs\") pod \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") "
Oct 29 23:27:59.085331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085182    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm\") pod \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") "
Oct 29 23:27:59.085331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085217    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs\") pod \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") "
Oct 29 23:27:59.085462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085329    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir\") pod \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") "
Oct 29 23:27:59.085462 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085449    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache\") pod \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") "
Oct 29 23:27:59.085581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085514    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm\") pod \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") "
Oct 29 23:27:59.085581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085546    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq\" (UniqueName: \"kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq\") pod \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") "
Oct 29 23:27:59.085581 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085557    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir" pod "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" (UID: "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.085745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085596    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home\") pod \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") "
Oct 29 23:27:59.085745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085641    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9\" (UniqueName: \"kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9\") pod \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") "
Oct 29 23:27:59.085745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085683    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache\") pod \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") "
Oct 29 23:27:59.085745 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085728    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir\") pod \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\" (UID: \"1056ff58-0daa-4e25-a809-15d4d3cfa15b\") "
Oct 29 23:27:59.085957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085769    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home\") pod \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\" (UID: \"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0\") "
Oct 29 23:27:59.085957 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.085843    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home" pod "1056ff58-0daa-4e25-a809-15d4d3cfa15b" (UID: "1056ff58-0daa-4e25-a809-15d4d3cfa15b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.086065 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086023    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache" pod "1056ff58-0daa-4e25-a809-15d4d3cfa15b" (UID: "1056ff58-0daa-4e25-a809-15d4d3cfa15b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.086171 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086143    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir" pod "1056ff58-0daa-4e25-a809-15d4d3cfa15b" (UID: "1056ff58-0daa-4e25-a809-15d4d3cfa15b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.086234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086201    5044 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tmp-dir\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.086234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086222    5044 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-home\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.086341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086236    5044 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-model-cache\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.086341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086203    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache" pod "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" (UID: "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.086436 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.086400    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home" pod "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" (UID: "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.088580 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.088553    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm" pod "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" (UID: "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.088716 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.088653    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9" pod "1056ff58-0daa-4e25-a809-15d4d3cfa15b" (UID: "1056ff58-0daa-4e25-a809-15d4d3cfa15b"). InnerVolumeSpecName "kube-api-access-g9hk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:59.088946 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.088915    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs" pod "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" (UID: "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:59.089033 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.088974    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs" pod "1056ff58-0daa-4e25-a809-15d4d3cfa15b" (UID: "1056ff58-0daa-4e25-a809-15d4d3cfa15b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:27:59.089033 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.088990    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm" pod "1056ff58-0daa-4e25-a809-15d4d3cfa15b" (UID: "1056ff58-0daa-4e25-a809-15d4d3cfa15b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:27:59.089247 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.089227    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq" pod "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" (UID: "e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0"). InnerVolumeSpecName "kube-api-access-bhhcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187637    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9hk9\" (UniqueName: \"kubernetes.io/projected/1056ff58-0daa-4e25-a809-15d4d3cfa15b-kube-api-access-g9hk9\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187667    5044 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tmp-dir\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187676    5044 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-home\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187683    5044 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1056ff58-0daa-4e25-a809-15d4d3cfa15b-tls-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187691    5044 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-dshm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187698    5044 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-tls-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187706    5044 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-model-cache\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187714    5044 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1056ff58-0daa-4e25-a809-15d4d3cfa15b-dshm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.187718 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.187722    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhhcq\" (UniqueName: \"kubernetes.io/projected/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0-kube-api-access-bhhcq\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:27:59.342441 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.342408    5044 generic.go:356] "Generic (PLEG): container finished" podID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" containerID="b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618" exitCode=0
Oct 29 23:27:59.342631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.342450    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"
Oct 29 23:27:59.342631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.342498    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" event={"ID":"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0","Type":"ContainerDied","Data":"b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618"}
Oct 29 23:27:59.342631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.342540    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz" event={"ID":"e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0","Type":"ContainerDied","Data":"4154468084dbd6833b97a8bcb9542e2b460f8b56673752caa5110f72c2e7b4f7"}
Oct 29 23:27:59.342631 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.342558    5044 scope.go:122] "RemoveContainer" containerID="b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618"
Oct 29 23:27:59.344121 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.344097    5044 generic.go:356] "Generic (PLEG): container finished" podID="1056ff58-0daa-4e25-a809-15d4d3cfa15b" containerID="b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c" exitCode=0
Oct 29 23:27:59.344255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.344126    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp" event={"ID":"1056ff58-0daa-4e25-a809-15d4d3cfa15b","Type":"ContainerDied","Data":"b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c"}
Oct 29 23:27:59.344255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.344151    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"
Oct 29 23:27:59.344255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.344161    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp" event={"ID":"1056ff58-0daa-4e25-a809-15d4d3cfa15b","Type":"ContainerDied","Data":"bee30bec3140d21ef96c00b9a9575ae5c64be0b89d28bc08956b8764c9aaf217"}
Oct 29 23:27:59.346394 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.346373    5044 generic.go:356] "Generic (PLEG): container finished" podID="074d9f4b-8b18-4fa1-8000-9054b7e48116" containerID="7690f49ec9333b9b08222ca9b4ce1555b53abcd991543da5e901e45d0160de59" exitCode=0
Oct 29 23:27:59.346516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.346429    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx" event={"ID":"074d9f4b-8b18-4fa1-8000-9054b7e48116","Type":"ContainerDied","Data":"7690f49ec9333b9b08222ca9b4ce1555b53abcd991543da5e901e45d0160de59"}
Oct 29 23:27:59.359239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.359222    5044 scope.go:122] "RemoveContainer" containerID="b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618"
Oct 29 23:27:59.359517 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:59.359498    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618\": container with ID starting with b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618 not found: ID does not exist" containerID="b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618"
Oct 29 23:27:59.359579 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.359524    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618"} err="failed to get container status \"b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618\": rpc error: code = NotFound desc = could not find container \"b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618\": container with ID starting with b9241cc91d4d473e9ad9d9b2ceded8c49be29b9e2e1173a39130503050068618 not found: ID does not exist"
Oct 29 23:27:59.359579 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.359540    5044 scope.go:122] "RemoveContainer" containerID="b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c"
Oct 29 23:27:59.368255 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.368235    5044 scope.go:122] "RemoveContainer" containerID="b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c"
Oct 29 23:27:59.368544 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:27:59.368520    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c\": container with ID starting with b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c not found: ID does not exist" containerID="b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c"
Oct 29 23:27:59.368633 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.368549    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c"} err="failed to get container status \"b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c\": rpc error: code = NotFound desc = could not find container \"b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c\": container with ID starting with b88d67af893178567585694b5ab24a7b5b488d8e86639d32390200ffffdcab4c not found: ID does not exist"
Oct 29 23:27:59.441372 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.441298    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"]
Oct 29 23:27:59.445883 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.445857    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/premium-w2-bacddc-kserve-85cff9dc89-2t6vp"]
Oct 29 23:27:59.480356 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.479316    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"]
Oct 29 23:27:59.484892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.484865    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-bacddc/simulator-w2-bacddc-kserve-5674bbb6cb-7rxmz"]
Oct 29 23:27:59.690288 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.690226    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:27:59.780621 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:27:59.780560    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerName="payload-pre-processing" containerID="cri-o://5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df" gracePeriod=25
Oct 29 23:28:00.359176 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.359140    5044 generic.go:356] "Generic (PLEG): container finished" podID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerID="bb64d925895a1ebd3191aaf7bfe0e7751b4bf8194ec190bbc509adaaadeddc46" exitCode=0
Oct 29 23:28:00.359599 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.359207    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" event={"ID":"9b9708f6-96e2-4b1f-adcc-03393e374604","Type":"ContainerDied","Data":"bb64d925895a1ebd3191aaf7bfe0e7751b4bf8194ec190bbc509adaaadeddc46"}
Oct 29 23:28:00.412141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.412073    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:28:00.505843 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.505812    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.505875    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506011 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.505910    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506029    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506106    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506143 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506125    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:00.506303 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506159    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506303 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506193    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506303 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506231    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506303 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506261    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo\") pod \"9b9708f6-96e2-4b1f-adcc-03393e374604\" (UID: \"9b9708f6-96e2-4b1f-adcc-03393e374604\") "
Oct 29 23:28:00.506513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506326    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:00.506746 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506717    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.506746 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506744    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.506916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506791    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:00.506916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506876    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:00.506916 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.506906    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:28:00.508506 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.508450    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:00.509141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.509121    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:28:00.509239 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.509169    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "kube-api-access-zs6vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:00.509592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.509576    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token" pod "9b9708f6-96e2-4b1f-adcc-03393e374604" (UID: "9b9708f6-96e2-4b1f-adcc-03393e374604"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:00.528317 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.528296    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:28:00.607823 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607790    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b9708f6-96e2-4b1f-adcc-03393e374604-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.607823 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607825    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.608022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607838    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.608022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607851    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.608022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607863    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b9708f6-96e2-4b1f-adcc-03393e374604-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.608022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607879    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs6vd\" (UniqueName: \"kubernetes.io/projected/9b9708f6-96e2-4b1f-adcc-03393e374604-kube-api-access-zs6vd\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.608022 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.607892    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b9708f6-96e2-4b1f-adcc-03393e374604-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.709025 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.708997    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca\") pod \"074d9f4b-8b18-4fa1-8000-9054b7e48116\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") "
Oct 29 23:28:00.709186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.709132    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca\") pod \"074d9f4b-8b18-4fa1-8000-9054b7e48116\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") "
Oct 29 23:28:00.709186 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.709176    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln\" (UniqueName: \"kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln\") pod \"074d9f4b-8b18-4fa1-8000-9054b7e48116\" (UID: \"074d9f4b-8b18-4fa1-8000-9054b7e48116\") "
Oct 29 23:28:00.709426 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.709401    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca" pod "074d9f4b-8b18-4fa1-8000-9054b7e48116" (UID: "074d9f4b-8b18-4fa1-8000-9054b7e48116"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:28:00.709576 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.709554    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-openshift-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.711274 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.711242    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln" pod "074d9f4b-8b18-4fa1-8000-9054b7e48116" (UID: "074d9f4b-8b18-4fa1-8000-9054b7e48116"). InnerVolumeSpecName "kube-api-access-mczln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:00.711274 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.711269    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca" pod "074d9f4b-8b18-4fa1-8000-9054b7e48116" (UID: "074d9f4b-8b18-4fa1-8000-9054b7e48116"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:28:00.810493 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.810448    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mczln\" (UniqueName: \"kubernetes.io/projected/074d9f4b-8b18-4fa1-8000-9054b7e48116-kube-api-access-mczln\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.810628 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.810502    5044 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/074d9f4b-8b18-4fa1-8000-9054b7e48116-maas-api-xks-ca\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:00.820326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.820298    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1056ff58-0daa-4e25-a809-15d4d3cfa15b" path="/var/lib/kubelet/pods/1056ff58-0daa-4e25-a809-15d4d3cfa15b/volumes"
Oct 29 23:28:00.820724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:00.820711    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" path="/var/lib/kubelet/pods/e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0/volumes"
Oct 29 23:28:01.369958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.369928    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"
Oct 29 23:28:01.370384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.369963    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn" event={"ID":"9b9708f6-96e2-4b1f-adcc-03393e374604","Type":"ContainerDied","Data":"a6aab374986639897556ae01cc1914f28e5fe23c30f5fb3e5f8121f3622b3bdb"}
Oct 29 23:28:01.370384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.370019    5044 scope.go:122] "RemoveContainer" containerID="bb64d925895a1ebd3191aaf7bfe0e7751b4bf8194ec190bbc509adaaadeddc46"
Oct 29 23:28:01.371454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.371434    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx" event={"ID":"074d9f4b-8b18-4fa1-8000-9054b7e48116","Type":"ContainerDied","Data":"3f97742bf9ae7efc21dadf51fa592b55e01407607bafb33dbc7f876f63953d62"}
Oct 29 23:28:01.371556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.371500    5044 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f97742bf9ae7efc21dadf51fa592b55e01407607bafb33dbc7f876f63953d62"
Oct 29 23:28:01.371556 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.371534    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-34040f67-drxvx"
Oct 29 23:28:01.430781 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.430753    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"]
Oct 29 23:28:01.441821 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:01.441795    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d9897b54c-h9shn"]
Oct 29 23:28:02.820495 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:02.820445    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" path="/var/lib/kubelet/pods/9b9708f6-96e2-4b1f-adcc-03393e374604/volumes"
Oct 29 23:28:04.026933 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.026864    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894" podUID="5a5e22f2-7e1a-4423-ba11-44ca246b6fab" containerName="main" containerID="cri-o://03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4" gracePeriod=45
Oct 29 23:28:04.300801 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.300777    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:28:04.394326 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.394290    5044 generic.go:356] "Generic (PLEG): container finished" podID="5a5e22f2-7e1a-4423-ba11-44ca246b6fab" containerID="03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4" exitCode=0
Oct 29 23:28:04.394524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.394339    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"
Oct 29 23:28:04.394524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.394370    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894" event={"ID":"5a5e22f2-7e1a-4423-ba11-44ca246b6fab","Type":"ContainerDied","Data":"03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4"}
Oct 29 23:28:04.394524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.394431    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894" event={"ID":"5a5e22f2-7e1a-4423-ba11-44ca246b6fab","Type":"ContainerDied","Data":"f9108b5d9ba9230b302dddc6a0ff3f5355c48cf3e2a530d58d6844796969cb86"}
Oct 29 23:28:04.394524 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.394458    5044 scope.go:122] "RemoveContainer" containerID="03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4"
Oct 29 23:28:04.405397 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.405317    5044 scope.go:122] "RemoveContainer" containerID="03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4"
Oct 29 23:28:04.405656 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:04.405630    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4\": container with ID starting with 03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4 not found: ID does not exist" containerID="03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4"
Oct 29 23:28:04.405725 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.405661    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4"} err="failed to get container status \"03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4\": rpc error: code = NotFound desc = could not find container \"03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4\": container with ID starting with 03e3808b54ba5bf57510463f8a7caacf36b4cdca0ac314f22c989e1d52303ec4 not found: ID does not exist"
Oct 29 23:28:04.445958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.445925    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache\") pod \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") "
Oct 29 23:28:04.446125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446025    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm\") pod \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") "
Oct 29 23:28:04.446125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446087    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs\") pod \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") "
Oct 29 23:28:04.446125 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446121    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home\") pod \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") "
Oct 29 23:28:04.446277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446147    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir\") pod \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") "
Oct 29 23:28:04.446277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446211    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache" pod "5a5e22f2-7e1a-4423-ba11-44ca246b6fab" (UID: "5a5e22f2-7e1a-4423-ba11-44ca246b6fab"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:04.446277 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446270    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh\" (UniqueName: \"kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh\") pod \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\" (UID: \"5a5e22f2-7e1a-4423-ba11-44ca246b6fab\") "
Oct 29 23:28:04.446455 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446433    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home" pod "5a5e22f2-7e1a-4423-ba11-44ca246b6fab" (UID: "5a5e22f2-7e1a-4423-ba11-44ca246b6fab"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:04.446615 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446599    5044 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-home\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:04.446672 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446621    5044 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-model-cache\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:04.446672 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.446621    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir" pod "5a5e22f2-7e1a-4423-ba11-44ca246b6fab" (UID: "5a5e22f2-7e1a-4423-ba11-44ca246b6fab"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:04.448682 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.448643    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm" pod "5a5e22f2-7e1a-4423-ba11-44ca246b6fab" (UID: "5a5e22f2-7e1a-4423-ba11-44ca246b6fab"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:04.448797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.448679    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs" pod "5a5e22f2-7e1a-4423-ba11-44ca246b6fab" (UID: "5a5e22f2-7e1a-4423-ba11-44ca246b6fab"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 29 23:28:04.448797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.448721    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh" pod "5a5e22f2-7e1a-4423-ba11-44ca246b6fab" (UID: "5a5e22f2-7e1a-4423-ba11-44ca246b6fab"). InnerVolumeSpecName "kube-api-access-4jjhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:04.451582 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.451556    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:04.547797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.547719    5044 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tls-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:04.547797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.547769    5044 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-tmp-dir\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:04.547797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.547779    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jjhh\" (UniqueName: \"kubernetes.io/projected/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-kube-api-access-4jjhh\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:04.547797 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.547789    5044 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a5e22f2-7e1a-4423-ba11-44ca246b6fab-dshm\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:04.744821 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.744784    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"]
Oct 29 23:28:04.755635 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.755606    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-bed4a2/simulator-w4-bed4a2-kserve-7bb7689c65-cx894"]
Oct 29 23:28:04.820646 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.820574    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a5e22f2-7e1a-4423-ba11-44ca246b6fab" path="/var/lib/kubelet/pods/5a5e22f2-7e1a-4423-ba11-44ca246b6fab/volumes"
Oct 29 23:28:04.913759 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:04.913726    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:05.010865 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:05.010834    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"]
Oct 29 23:28:05.016161 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:05.015231    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-bacddc-whfqt"]
Oct 29 23:28:05.060831 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:05.060796    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:05.264526 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:05.264461    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:28:05.553983 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:05.553893    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:06.820341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:06.820298    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23bfc32e-8446-4390-bbc1-23d98de6c2d4" path="/var/lib/kubelet/pods/23bfc32e-8446-4390-bbc1-23d98de6c2d4/volumes"
Oct 29 23:28:09.075014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:09.074989    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:28:09.078845 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:09.078825    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:28:10.526225 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:10.526189    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:28:11.856112 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:11.856078    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:12.000071 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:12.000033    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:12.103292 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:12.103244    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"]
Oct 29 23:28:12.103610 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:12.103556    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy" containerID="cri-o://4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2" gracePeriod=30
Oct 29 23:28:12.319017 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:12.318977    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:12.660744 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:12.660649    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:13.168513 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:13.168297    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:13.271390 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:13.271347    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"]
Oct 29 23:28:13.280054 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:13.280026    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-bed4a2-9tk8x"]
Oct 29 23:28:13.306024 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:13.305985    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:13.782694 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:13.782662    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:14.820668 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:14.820639    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4c616e0f-b9a4-487d-b266-2ab24f618f01" path="/var/lib/kubelet/pods/4c616e0f-b9a4-487d-b266-2ab24f618f01/volumes"
Oct 29 23:28:15.264696 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:15.264656    5044 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 29 23:28:17.359108 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.359080    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:28:17.476073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476039    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476259 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476116    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476259 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476174    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476259 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476229    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476265    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476308    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476425 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476346    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476418    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:28:17.476619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476442    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476443    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:17.476619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476504    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket\") pod \"36863338-77db-48dd-a2b0-1fe43d26b7dc\" (UID: \"36863338-77db-48dd-a2b0-1fe43d26b7dc\") "
Oct 29 23:28:17.476804 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476779    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:17.476881 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476855    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:17.476941 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476929    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.476996 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476981    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/36863338-77db-48dd-a2b0-1fe43d26b7dc-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.477049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.476996    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.477049 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.477014    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:17.478982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.478896    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:28:17.478982 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.478897    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "kube-api-access-lf7rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:17.479156 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479121    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:17.479156 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479122    5044 generic.go:356] "Generic (PLEG): container finished" podID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerID="4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2" exitCode=0
Oct 29 23:28:17.479234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479151    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" event={"ID":"36863338-77db-48dd-a2b0-1fe43d26b7dc","Type":"ContainerDied","Data":"4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2"}
Oct 29 23:28:17.479234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479196    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"
Oct 29 23:28:17.479234 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479217    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token" pod "36863338-77db-48dd-a2b0-1fe43d26b7dc" (UID: "36863338-77db-48dd-a2b0-1fe43d26b7dc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:17.479346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479248    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb" event={"ID":"36863338-77db-48dd-a2b0-1fe43d26b7dc","Type":"ContainerDied","Data":"d14bf5d3075e8abc0fb035ac398a4c4ea0f857a9990d8bd879b2f940efde8b73"}
Oct 29 23:28:17.479346 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.479285    5044 scope.go:122] "RemoveContainer" containerID="4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2"
Oct 29 23:28:17.505897 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.505874    5044 scope.go:122] "RemoveContainer" containerID="5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"
Oct 29 23:28:17.515174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.514776    5044 scope.go:122] "RemoveContainer" containerID="4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2"
Oct 29 23:28:17.515174 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:17.515044    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2\": container with ID starting with 4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2 not found: ID does not exist" containerID="4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2"
Oct 29 23:28:17.515174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.515070    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2"} err="failed to get container status \"4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2\": rpc error: code = NotFound desc = could not find container \"4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2\": container with ID starting with 4184eb76e16d87dcae1aca151b7423d3028e40564a646ae7590e93868b58eaf2 not found: ID does not exist"
Oct 29 23:28:17.515174 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.515088    5044 scope.go:122] "RemoveContainer" containerID="5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"
Oct 29 23:28:17.515380 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:17.515352    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac\": container with ID starting with 5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac not found: ID does not exist" containerID="5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"
Oct 29 23:28:17.515447 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.515422    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac"} err="failed to get container status \"5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac\": rpc error: code = NotFound desc = could not find container \"5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac\": container with ID starting with 5e9587519d16bd1137921e91c3b2d1980cfcd55f4f06a3a8fca4acb722acafac not found: ID does not exist"
Oct 29 23:28:17.537688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.537661    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"]
Oct 29 23:28:17.541025 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.541001    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-bacddc-openshift-default-5bd9fdf475-2f6wb"]
Oct 29 23:28:17.578224 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.578196    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.578224 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.578220    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.578401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.578229    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.578401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.578239    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.578401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.578248    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/36863338-77db-48dd-a2b0-1fe43d26b7dc-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:17.578401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:17.578255    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf7rp\" (UniqueName: \"kubernetes.io/projected/36863338-77db-48dd-a2b0-1fe43d26b7dc-kube-api-access-lf7rp\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:18.820958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:18.820927    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" path="/var/lib/kubelet/pods/36863338-77db-48dd-a2b0-1fe43d26b7dc/volumes"
Oct 29 23:28:20.030510 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.030471    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:28:20.101726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.101649    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume\") pod \"48070e48-fe6b-4885-b6bb-7ec7fa898233\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") "
Oct 29 23:28:20.101726 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.101725    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n\" (UniqueName: \"kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n\") pod \"48070e48-fe6b-4885-b6bb-7ec7fa898233\" (UID: \"48070e48-fe6b-4885-b6bb-7ec7fa898233\") "
Oct 29 23:28:20.102073 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.102048    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume" pod "48070e48-fe6b-4885-b6bb-7ec7fa898233" (UID: "48070e48-fe6b-4885-b6bb-7ec7fa898233"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:28:20.102199 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.102125    5044 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48070e48-fe6b-4885-b6bb-7ec7fa898233-plugins-config-volume\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:20.103769 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.103743    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n" pod "48070e48-fe6b-4885-b6bb-7ec7fa898233" (UID: "48070e48-fe6b-4885-b6bb-7ec7fa898233"). InnerVolumeSpecName "kube-api-access-dhr5n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:20.203003 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.202970    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhr5n\" (UniqueName: \"kubernetes.io/projected/48070e48-fe6b-4885-b6bb-7ec7fa898233-kube-api-access-dhr5n\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:20.493854 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.493799    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:20.498683 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.498655    5044 generic.go:356] "Generic (PLEG): container finished" podID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerID="5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df" exitCode=0
Oct 29 23:28:20.498826 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.498708    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"
Oct 29 23:28:20.498826 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.498740    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" event={"ID":"48070e48-fe6b-4885-b6bb-7ec7fa898233","Type":"ContainerDied","Data":"5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df"}
Oct 29 23:28:20.498826 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.498802    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj" event={"ID":"48070e48-fe6b-4885-b6bb-7ec7fa898233","Type":"ContainerDied","Data":"9c2223eea79498a746693543d85367f6c4211d27dfb978e624bcc0912e75f58b"}
Oct 29 23:28:20.498985 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.498835    5044 scope.go:122] "RemoveContainer" containerID="5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df"
Oct 29 23:28:20.509992 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.509972    5044 scope.go:122] "RemoveContainer" containerID="5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df"
Oct 29 23:28:20.510252 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:20.510236    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df\": container with ID starting with 5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df not found: ID does not exist" containerID="5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df"
Oct 29 23:28:20.510319 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.510259    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df"} err="failed to get container status \"5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df\": rpc error: code = NotFound desc = could not find container \"5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df\": container with ID starting with 5142195cf1ee090982bc536e012e739373bfefe666ec3499b67bf4217964f3df not found: ID does not exist"
Oct 29 23:28:20.548966 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.548937    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"]
Oct 29 23:28:20.560354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.560322    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-bed4a2-54467f9d9f-bg2jj"]
Oct 29 23:28:20.644972 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.644939    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:20.707997 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.707958    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"]
Oct 29 23:28:20.708379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.708222    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy" containerID="cri-o://ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b" gracePeriod=30
Oct 29 23:28:20.716545 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.716515    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"]
Oct 29 23:28:20.716784 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.716750    5044 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy" containerID="cri-o://7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416" gracePeriod=30
Oct 29 23:28:20.808446 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.808342    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:20.824133 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.824090    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" path="/var/lib/kubelet/pods/48070e48-fe6b-4885-b6bb-7ec7fa898233/volumes"
Oct 29 23:28:20.957968 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:20.957932    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:22.034954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:22.034922    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:22.045707 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:22.045676    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-9pjrl_3138ed5e-517d-41c5-8db4-e66c8e8ad523/manager/0.log"
Oct 29 23:28:22.440238 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:22.440168    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j9gfc_761f5568-5049-4c79-b02c-9fd14fbe5009/kuadrant-console-plugin/0.log"
Oct 29 23:28:23.185368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:23.185335    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-kjkc2_f0cf0719-50ae-421c-8a9f-523a76cb1525/manager/0.log"
Oct 29 23:28:24.270341 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:24.270307    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:28:25.974509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:25.974471    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:28:26.004375 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.004351    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:28:26.064662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064636    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.064856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064673    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.064856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064705    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.064856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064724    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.064856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064752    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.064856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064784    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.064856 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064850    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064891    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064955    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064968    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.064982    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065003    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065018    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065036    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065051    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065098    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065123    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.065270 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065131    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065274    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065320    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo\") pod \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\" (UID: \"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17\") "
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065363    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065371    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065393    5044 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token\") pod \"9d911b59-c9fc-43f4-a254-816ff9818469\" (UID: \"9d911b59-c9fc-43f4-a254-816ff9818469\") "
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065465    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.065803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065699    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065930    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065955    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065969    5044 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065982    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.065998    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d911b59-c9fc-43f4-a254-816ff9818469-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.066012    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066169 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.066025    5044 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-data\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.066641 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.066339    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 29 23:28:26.067079 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.066986    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.067079 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.067039    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.068376 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.068347    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.069114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.068547    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "kube-api-access-bcbmg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:26.069114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.068663    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:28:26.069114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.068728    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 29 23:28:26.069114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.068840    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:26.069114 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.068948    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "kube-api-access-xl6fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:26.069713 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.069687    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token" pod "9d911b59-c9fc-43f4-a254-816ff9818469" (UID: "9d911b59-c9fc-43f4-a254-816ff9818469"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 29 23:28:26.069832 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.069740    5044 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo" pod "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" (UID: "1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 29 23:28:26.166902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166864    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d911b59-c9fc-43f4-a254-816ff9818469-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.166902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166893    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl6fw\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-kube-api-access-xl6fw\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.166902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166903    5044 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcbmg\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-kube-api-access-bcbmg\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.166902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166912    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166921    5044 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istiod-ca-cert\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166931    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166939    5044 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-envoy\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166947    5044 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-workload-certs\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166955    5044 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17-istio-podinfo\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166963    5044 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d911b59-c9fc-43f4-a254-816ff9818469-credential-socket\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.167167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.166970    5044 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d911b59-c9fc-43f4-a254-816ff9818469-istio-token\") on node \"ip-10-0-134-8.ec2.internal\" DevicePath \"\""
Oct 29 23:28:26.503128 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.503094    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:26.536217 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.536180    5044 generic.go:356] "Generic (PLEG): container finished" podID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerID="ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b" exitCode=0
Oct 29 23:28:26.536406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.536227    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"
Oct 29 23:28:26.536406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.536269    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" event={"ID":"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17","Type":"ContainerDied","Data":"ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b"}
Oct 29 23:28:26.536406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.536327    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw" event={"ID":"1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17","Type":"ContainerDied","Data":"be959668a8aa68d007ee31ebfdd61fc2d8b14a56ecf1dc812e512b0f459fa044"}
Oct 29 23:28:26.536406 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.536359    5044 scope.go:122] "RemoveContainer" containerID="ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b"
Oct 29 23:28:26.538313 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.538288    5044 generic.go:356] "Generic (PLEG): container finished" podID="9d911b59-c9fc-43f4-a254-816ff9818469" containerID="7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416" exitCode=0
Oct 29 23:28:26.538414 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.538349    5044 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"
Oct 29 23:28:26.538414 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.538362    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" event={"ID":"9d911b59-c9fc-43f4-a254-816ff9818469","Type":"ContainerDied","Data":"7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416"}
Oct 29 23:28:26.538414 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.538411    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc" event={"ID":"9d911b59-c9fc-43f4-a254-816ff9818469","Type":"ContainerDied","Data":"9f6f306064a4fb426255d3ac380280dedc9c0edac9a8e6e6675296bb38177ad9"}
Oct 29 23:28:26.545910 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.545892    5044 scope.go:122] "RemoveContainer" containerID="ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b"
Oct 29 23:28:26.546189 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:26.546170    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b\": container with ID starting with ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b not found: ID does not exist" containerID="ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b"
Oct 29 23:28:26.546272 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.546196    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b"} err="failed to get container status \"ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b\": rpc error: code = NotFound desc = could not find container \"ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b\": container with ID starting with ed14efa6ceff22154c62ceb90a65fea9ee25e92f7770ab460ca8debaf31ba98b not found: ID does not exist"
Oct 29 23:28:26.546272 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.546212    5044 scope.go:122] "RemoveContainer" containerID="7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416"
Oct 29 23:28:26.554945 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.554927    5044 scope.go:122] "RemoveContainer" containerID="74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"
Oct 29 23:28:26.563141 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.563126    5044 scope.go:122] "RemoveContainer" containerID="7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416"
Oct 29 23:28:26.563393 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:26.563376    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416\": container with ID starting with 7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416 not found: ID does not exist" containerID="7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416"
Oct 29 23:28:26.563439 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.563398    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416"} err="failed to get container status \"7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416\": rpc error: code = NotFound desc = could not find container \"7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416\": container with ID starting with 7ae0917cdb14759c937585c457b964d636145b987b1833a8a983882424095416 not found: ID does not exist"
Oct 29 23:28:26.563439 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.563416    5044 scope.go:122] "RemoveContainer" containerID="74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"
Oct 29 23:28:26.563651 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:26.563634    5044 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1\": container with ID starting with 74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1 not found: ID does not exist" containerID="74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"
Oct 29 23:28:26.563695 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.563656    5044 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1"} err="failed to get container status \"74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1\": rpc error: code = NotFound desc = could not find container \"74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1\": container with ID starting with 74f615905186e45a35e03ebb96ab5d8be89d6444e434bacda7dd602d6c3f5fd1 not found: ID does not exist"
Oct 29 23:28:26.588729 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.588707    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"]
Oct 29 23:28:26.599867 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.599842    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-j52kw"]
Oct 29 23:28:26.635140 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.635100    5044 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"]
Oct 29 23:28:26.643227 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.643196    5044 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-bed4a2-openshift-default-869484f5cc-4nxcc"]
Oct 29 23:28:26.658473 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.658437    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:26.819828 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.819767    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" path="/var/lib/kubelet/pods/1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17/volumes"
Oct 29 23:28:26.820197 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:26.820184    5044 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" path="/var/lib/kubelet/pods/9d911b59-c9fc-43f4-a254-816ff9818469/volumes"
Oct 29 23:28:27.756589 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:27.756554    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:32.958589 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:32.958551    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:36.577706 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:36.577664    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:28:38.808422 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:38.808392    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-25562112-prrvb_e8383cab-0805-42ba-b08c-d2edd8e5b056/revoke-keys/0.log"
Oct 29 23:28:38.987612 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:38.987569    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-34040f67-drxvx_074d9f4b-8b18-4fa1-8000-9054b7e48116/revoke-keys/0.log"
Oct 29 23:28:39.172299 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:39.172223    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-37306811-x5sp7_49165538-2f7c-493d-865a-f08fc0298ad9/revoke-keys/0.log"
Oct 29 23:28:39.692902 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:39.692874    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-55d44ce2-sdtdw_1438130c-5bd5-49ee-ab63-43628e2346ff/revoke-keys/0.log"
Oct 29 23:28:39.873333 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:39.873302    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-5631b502-4b8jq_f19592c0-e059-4336-8b5b-934b6c55fbc8/revoke-keys/0.log"
Oct 29 23:28:40.229454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:40.229428    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-647cb05f-mkg57_7bb939e7-9bdb-4739-8a30-9096e511a7aa/revoke-keys/0.log"
Oct 29 23:28:40.526326 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:28:40.526246    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:28:40.589644 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:40.589617    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-8a907349-d4xnn_6e254527-d4df-45d3-87a5-a07f0f3a3ec2/revoke-keys/0.log"
Oct 29 23:28:40.761384 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:40.761350    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-9cb5ca21-pdcl4_ef11e685-5645-4c33-ad20-f499925f7924/revoke-keys/0.log"
Oct 29 23:28:41.321899 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:41.321868    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-bb4401dc-xnvsm_b8290442-8829-4560-9859-2724ae65a54f/revoke-keys/0.log"
Oct 29 23:28:41.488823 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:41.488782    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-ceb89723-hnj8s_e27ac592-6670-4185-802f-f71009255bbd/revoke-keys/0.log"
Oct 29 23:28:43.523308 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:43.523271    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-9pjrl_3138ed5e-517d-41c5-8db4-e66c8e8ad523/manager/0.log"
Oct 29 23:28:43.886780 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:43.886709    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j9gfc_761f5568-5049-4c79-b02c-9fd14fbe5009/kuadrant-console-plugin/0.log"
Oct 29 23:28:44.628962 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:44.628928    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-kjkc2_f0cf0719-50ae-421c-8a9f-523a76cb1525/manager/0.log"
Oct 29 23:28:45.342028 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:45.341993    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:28:46.307985 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:46.307936    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:28:47.054568 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:47.054538    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:28:47.590835 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:47.590808    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:28:48.810086 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:48.810057    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-pr2jg_80cf30d8-9fce-4b84-b53d-74c2e8653ce6/main/0.log"
Oct 29 23:28:48.988722 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:48.988694    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-pkr9m_61d25ac9-78a3-4ca9-80d0-7f78918fcc02/main/0.log"
Oct 29 23:28:49.374823 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:49.374793    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-95cl9_96fb601e-a2a6-4f78-afa9-a32b77f4c22d/main/0.log"
Oct 29 23:28:49.776324 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:49.776295    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-kpnnl_5797dd50-ed80-4ea3-9e36-1ae7d3b5b089/main/0.log"
Oct 29 23:28:52.160848 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:52.160812    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:52.292257 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:52.292220    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:59.584609 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584576    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hjqhq/must-gather-nvgdg"]
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584960    5044 cpu_manager.go:414] "containerMap: removing container" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584970    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584983    5044 cpu_manager.go:414] "containerMap: removing container" podUID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" containerName="main"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584988    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" containerName="main"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584993    5044 cpu_manager.go:414] "containerMap: removing container" podUID="1056ff58-0daa-4e25-a809-15d4d3cfa15b" containerName="main"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.584998    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1056ff58-0daa-4e25-a809-15d4d3cfa15b" containerName="main"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585014    5044 cpu_manager.go:414] "containerMap: removing container" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585020    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585048    5044 cpu_manager.go:414] "containerMap: removing container" podUID="074d9f4b-8b18-4fa1-8000-9054b7e48116" containerName="revoke-keys"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585053    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="074d9f4b-8b18-4fa1-8000-9054b7e48116" containerName="revoke-keys"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585062    5044 cpu_manager.go:414] "containerMap: removing container" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585067    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy"
Oct 29 23:28:59.585072 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585078    5044 cpu_manager.go:414] "containerMap: removing container" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585083    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585089    5044 cpu_manager.go:414] "containerMap: removing container" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerName="payload-pre-processing"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585093    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerName="payload-pre-processing"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585101    5044 cpu_manager.go:414] "containerMap: removing container" podUID="5a5e22f2-7e1a-4423-ba11-44ca246b6fab" containerName="main"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585105    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a5e22f2-7e1a-4423-ba11-44ca246b6fab" containerName="main"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585111    5044 cpu_manager.go:414] "containerMap: removing container" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585117    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585169    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585177    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585183    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8ccf4b9-02e1-472a-aa1d-bc9a608d55c0" containerName="main"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585188    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="1056ff58-0daa-4e25-a809-15d4d3cfa15b" containerName="main"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585195    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="1dfc7e80-bc12-4d22-bc07-f9ff70ee6d17" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585202    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="074d9f4b-8b18-4fa1-8000-9054b7e48116" containerName="revoke-keys"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585208    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585214    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="9b9708f6-96e2-4b1f-adcc-03393e374604" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585219    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="48070e48-fe6b-4885-b6bb-7ec7fa898233" containerName="payload-pre-processing"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585224    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a5e22f2-7e1a-4423-ba11-44ca246b6fab" containerName="main"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585229    5044 memory_manager.go:365] "RemoveStaleState removing state" podUID="36863338-77db-48dd-a2b0-1fe43d26b7dc" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585297    5044 cpu_manager.go:414] "containerMap: removing container" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy"
Oct 29 23:28:59.585454 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.585302    5044 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9d911b59-c9fc-43f4-a254-816ff9818469" containerName="istio-proxy"
Oct 29 23:28:59.593701 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.593664    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.609775 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.609741    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hjqhq/must-gather-nvgdg"]
Oct 29 23:28:59.618748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.618708    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hjqhq\"/\"openshift-service-ca.crt\""
Oct 29 23:28:59.618748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.618717    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hjqhq\"/\"default-dockercfg-7f8qm\""
Oct 29 23:28:59.618955 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.618749    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hjqhq\"/\"kube-root-ca.crt\""
Oct 29 23:28:59.638420 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.638391    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:28:59.672518 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.672486    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxq75\" (UniqueName: \"kubernetes.io/projected/ae8b9443-7e26-465c-86c4-82bc3d61d883-kube-api-access-gxq75\") pod \"must-gather-nvgdg\" (UID: \"ae8b9443-7e26-465c-86c4-82bc3d61d883\") " pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.672688 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.672658    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae8b9443-7e26-465c-86c4-82bc3d61d883-must-gather-output\") pod \"must-gather-nvgdg\" (UID: \"ae8b9443-7e26-465c-86c4-82bc3d61d883\") " pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.681594 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.681562    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rxpwv/must-gather-9r5bb"]
Oct 29 23:28:59.685596 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.685576    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.703813 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.703791    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxpwv/must-gather-9r5bb"]
Oct 29 23:28:59.705592 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.705571    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxpwv\"/\"openshift-service-ca.crt\""
Oct 29 23:28:59.705841 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.705827    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rxpwv\"/\"kube-root-ca.crt\""
Oct 29 23:28:59.709913 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.709893    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rxpwv\"/\"default-dockercfg-lplqc\""
Oct 29 23:28:59.774233 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.774202    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bj2c\" (UniqueName: \"kubernetes.io/projected/7ba00f61-1362-4ec3-bf56-b8d5d603ad90-kube-api-access-8bj2c\") pod \"must-gather-9r5bb\" (UID: \"7ba00f61-1362-4ec3-bf56-b8d5d603ad90\") " pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.774379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.774264    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxq75\" (UniqueName: \"kubernetes.io/projected/ae8b9443-7e26-465c-86c4-82bc3d61d883-kube-api-access-gxq75\") pod \"must-gather-nvgdg\" (UID: \"ae8b9443-7e26-465c-86c4-82bc3d61d883\") " pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.774379 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.774369    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae8b9443-7e26-465c-86c4-82bc3d61d883-must-gather-output\") pod \"must-gather-nvgdg\" (UID: \"ae8b9443-7e26-465c-86c4-82bc3d61d883\") " pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.774456 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.774413    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ba00f61-1362-4ec3-bf56-b8d5d603ad90-must-gather-output\") pod \"must-gather-9r5bb\" (UID: \"7ba00f61-1362-4ec3-bf56-b8d5d603ad90\") " pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.774724 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.774707    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ae8b9443-7e26-465c-86c4-82bc3d61d883-must-gather-output\") pod \"must-gather-nvgdg\" (UID: \"ae8b9443-7e26-465c-86c4-82bc3d61d883\") " pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.793250 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.793222    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxq75\" (UniqueName: \"kubernetes.io/projected/ae8b9443-7e26-465c-86c4-82bc3d61d883-kube-api-access-gxq75\") pod \"must-gather-nvgdg\" (UID: \"ae8b9443-7e26-465c-86c4-82bc3d61d883\") " pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.875720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.875586    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ba00f61-1362-4ec3-bf56-b8d5d603ad90-must-gather-output\") pod \"must-gather-9r5bb\" (UID: \"7ba00f61-1362-4ec3-bf56-b8d5d603ad90\") " pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.875720 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.875626    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bj2c\" (UniqueName: \"kubernetes.io/projected/7ba00f61-1362-4ec3-bf56-b8d5d603ad90-kube-api-access-8bj2c\") pod \"must-gather-9r5bb\" (UID: \"7ba00f61-1362-4ec3-bf56-b8d5d603ad90\") " pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.883117 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.875892    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7ba00f61-1362-4ec3-bf56-b8d5d603ad90-must-gather-output\") pod \"must-gather-9r5bb\" (UID: \"7ba00f61-1362-4ec3-bf56-b8d5d603ad90\") " pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.894001 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.893976    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bj2c\" (UniqueName: \"kubernetes.io/projected/7ba00f61-1362-4ec3-bf56-b8d5d603ad90-kube-api-access-8bj2c\") pod \"must-gather-9r5bb\" (UID: \"7ba00f61-1362-4ec3-bf56-b8d5d603ad90\") " pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:28:59.911944 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.911920    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hjqhq/must-gather-nvgdg"
Oct 29 23:28:59.999696 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:28:59.999660    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rxpwv/must-gather-9r5bb"
Oct 29 23:29:00.204699 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:00.204673    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hjqhq/must-gather-nvgdg"]
Oct 29 23:29:00.205967 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:29:00.205938    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae8b9443_7e26_465c_86c4_82bc3d61d883.slice/crio-54d94d644cee0b2e84a6a15f51a08b35cdd47b6f9262e494b73bd151f996e4e0 WatchSource:0}: Error finding container 54d94d644cee0b2e84a6a15f51a08b35cdd47b6f9262e494b73bd151f996e4e0: Status 404 returned error can't find the container with id 54d94d644cee0b2e84a6a15f51a08b35cdd47b6f9262e494b73bd151f996e4e0
Oct 29 23:29:00.207696 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:00.207675    5044 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 29 23:29:00.298790 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:00.298762    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rxpwv/must-gather-9r5bb"]
Oct 29 23:29:00.299680 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:29:00.299657    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ba00f61_1362_4ec3_bf56_b8d5d603ad90.slice/crio-6ca03545472c28ed0416d0dcd04360e4a9b45872f8df40869ed722aa9986f687 WatchSource:0}: Error finding container 6ca03545472c28ed0416d0dcd04360e4a9b45872f8df40869ed722aa9986f687: Status 404 returned error can't find the container with id 6ca03545472c28ed0416d0dcd04360e4a9b45872f8df40869ed722aa9986f687
Oct 29 23:29:00.737876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:00.737843    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxpwv/must-gather-9r5bb" event={"ID":"7ba00f61-1362-4ec3-bf56-b8d5d603ad90","Type":"ContainerStarted","Data":"6ca03545472c28ed0416d0dcd04360e4a9b45872f8df40869ed722aa9986f687"}
Oct 29 23:29:00.738878 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:00.738848    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjqhq/must-gather-nvgdg" event={"ID":"ae8b9443-7e26-465c-86c4-82bc3d61d883","Type":"ContainerStarted","Data":"54d94d644cee0b2e84a6a15f51a08b35cdd47b6f9262e494b73bd151f996e4e0"}
Oct 29 23:29:01.279711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:01.279655    5044 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log" limit=1024
Oct 29 23:29:04.053711 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:04.053678    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-l4dmt_6cf9cc14-3177-4dc4-8f45-ab8f230d185c/global-pull-secret-syncer/0.log"
Oct 29 23:29:04.351881 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:04.351797    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-25hfz_50c71f90-e5d1-41b1-a902-dec4b4df0571/connection-checker/0.log"
Oct 29 23:29:04.460748 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:04.460599    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-jlxrw_2aa5feeb-9699-4404-83e5-17cf95e7c17e/connection-checker/0.log"
Oct 29 23:29:04.568833 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:04.568795    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-nh9gd_d6712f77-7134-416f-b4e9-271e5ba93e30/connection-checker/0.log"
Oct 29 23:29:04.702258 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:04.702173    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8b26b_a3b6629b-dbda-44d0-8f3e-7e3d52f84632/konnectivity-agent/0.log"
Oct 29 23:29:05.058611 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:05.058506    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-8.ec2.internal_8b2fbb4e01546248a6da67f357b48b89/haproxy/0.log"
Oct 29 23:29:06.792167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:06.792128    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxpwv/must-gather-9r5bb" event={"ID":"7ba00f61-1362-4ec3-bf56-b8d5d603ad90","Type":"ContainerStarted","Data":"6ab2f1b1106409282f36f075617adacfaa3ac66f343391ec7c672a209f227b70"}
Oct 29 23:29:06.792167 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:06.792182    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rxpwv/must-gather-9r5bb" event={"ID":"7ba00f61-1362-4ec3-bf56-b8d5d603ad90","Type":"ContainerStarted","Data":"f6ad30d16bb1b41e90b31f520d5dd2fc5b40727cab617364f0a8704da3546252"}
Oct 29 23:29:06.793997 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:06.793972    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjqhq/must-gather-nvgdg" event={"ID":"ae8b9443-7e26-465c-86c4-82bc3d61d883","Type":"ContainerStarted","Data":"00a834f399382be3c782fbc24078cae54fc37cda22b67034ffa963bc45965d2a"}
Oct 29 23:29:06.794103 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:06.794008    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hjqhq/must-gather-nvgdg" event={"ID":"ae8b9443-7e26-465c-86c4-82bc3d61d883","Type":"ContainerStarted","Data":"23d48be70f2f3b0123bddacfe078e95fc9acb5701b70be27709618b3e0e9772f"}
Oct 29 23:29:06.842135 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:06.842072    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-rxpwv/must-gather-9r5bb" podStartSLOduration=1.640118601 podStartE2EDuration="7.842052958s" totalImagesPullingTime="6.201934357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:06.82811688 +0000 UTC m=+958.139361205" watchObservedRunningTime="2026-10-29 23:29:06.842052958 +0000 UTC m=+958.153297285"
Oct 29 23:29:06.864709 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:06.864659    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-hjqhq/must-gather-nvgdg" podStartSLOduration=1.645354619 podStartE2EDuration="7.864645869s" totalImagesPullingTime="6.21929125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-29 23:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:06.864426183 +0000 UTC m=+958.175670510" watchObservedRunningTime="2026-10-29 23:29:06.864645869 +0000 UTC m=+958.175890194"
Oct 29 23:29:08.749653 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:08.749624    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:08.814803 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:08.814772    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:10.534624 ip-10-0-134-8 kubenswrapper[5044]: E1029 23:29:10.532986    5044 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-sgk28" containerName="extractor"
Oct 29 23:29:10.859878 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:10.859794    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:11.195253 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:11.195172    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:12.045096 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:12.045066    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-9pjrl_3138ed5e-517d-41c5-8db4-e66c8e8ad523/manager/0.log"
Oct 29 23:29:12.264321 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:12.264287    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j9gfc_761f5568-5049-4c79-b02c-9fd14fbe5009/kuadrant-console-plugin/0.log"
Oct 29 23:29:12.748433 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:12.748395    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-kjkc2_f0cf0719-50ae-421c-8a9f-523a76cb1525/manager/0.log"
Oct 29 23:29:12.896029 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:12.895995    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:13.211313 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:13.211227    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:14.266919 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.265353    5044 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"]
Oct 29 23:29:14.275662 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.275635    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.284686 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.284656    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"]
Oct 29 23:29:14.296519 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.295632    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vz8b8\"/\"kube-root-ca.crt\""
Oct 29 23:29:14.300449 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.300425    5044 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vz8b8\"/\"default-dockercfg-bwshg\""
Oct 29 23:29:14.300603 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.300556    5044 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vz8b8\"/\"openshift-service-ca.crt\""
Oct 29 23:29:14.445021 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.444987    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-podres\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.445204 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.445034    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-sys\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.445204 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.445130    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-lib-modules\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.445317 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.445232    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-proc\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.445317 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.445277    5044 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grcck\" (UniqueName: \"kubernetes.io/projected/b1034d17-99c2-4d97-993e-ef5bf6284d2a-kube-api-access-grcck\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.545961 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.545874    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-proc\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546115 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.545962    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grcck\" (UniqueName: \"kubernetes.io/projected/b1034d17-99c2-4d97-993e-ef5bf6284d2a-kube-api-access-grcck\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546115 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546009    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-proc\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546115 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546027    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-podres\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546115 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546089    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-podres\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546115 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546097    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-sys\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546282 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546140    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-sys\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546282 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546147    5044 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-lib-modules\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.546282 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.546202    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1034d17-99c2-4d97-993e-ef5bf6284d2a-lib-modules\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.566410 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.566373    5044 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grcck\" (UniqueName: \"kubernetes.io/projected/b1034d17-99c2-4d97-993e-ef5bf6284d2a-kube-api-access-grcck\") pod \"perf-node-gather-daemonset-jzvfc\" (UID: \"b1034d17-99c2-4d97-993e-ef5bf6284d2a\") " pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.589533 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.589284    5044 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:14.890520 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:14.890497    5044 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"]
Oct 29 23:29:14.892633 ip-10-0-134-8 kubenswrapper[5044]: W1029 23:29:14.892605    5044 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb1034d17_99c2_4d97_993e_ef5bf6284d2a.slice/crio-3ec68d0e78831c376fcf6cc02ca817e623eda1132a9a784f4843b715a737c7c1 WatchSource:0}: Error finding container 3ec68d0e78831c376fcf6cc02ca817e623eda1132a9a784f4843b715a737c7c1: Status 404 returned error can't find the container with id 3ec68d0e78831c376fcf6cc02ca817e623eda1132a9a784f4843b715a737c7c1
Oct 29 23:29:15.092868 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.092836    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:15.105816 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.105788    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-tx897_86d517f1-0115-4d62-983c-2ad7b98ebb94/cluster-monitoring-operator/0.log"
Oct 29 23:29:15.471386 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.471355    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:15.836318 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.836286    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:15.859210 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.859180    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc" event={"ID":"b1034d17-99c2-4d97-993e-ef5bf6284d2a","Type":"ContainerStarted","Data":"65a9bb293502d15d5269e89d774b11d3054710572fe3f04e45d9008417e72586"}
Oct 29 23:29:15.859354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.859227    5044 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc" event={"ID":"b1034d17-99c2-4d97-993e-ef5bf6284d2a","Type":"ContainerStarted","Data":"3ec68d0e78831c376fcf6cc02ca817e623eda1132a9a784f4843b715a737c7c1"}
Oct 29 23:29:15.859354 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.859257    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:15.897168 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:15.897125    5044 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc" podStartSLOduration=1.897113101 podStartE2EDuration="1.897113101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-29 23:29:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-29 23:29:15.896918567 +0000 UTC m=+967.208162893" watchObservedRunningTime="2026-10-29 23:29:15.897113101 +0000 UTC m=+967.208357467"
Oct 29 23:29:16.072024 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.071993    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:16.150938 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.150857    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:16.183401 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.183375    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctxl4_eb76746d-f3e8-418e-9d22-092d236c2a7d/node-exporter/0.log"
Oct 29 23:29:16.266372 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.266343    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:29:16.286226 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.286199    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctxl4_eb76746d-f3e8-418e-9d22-092d236c2a7d/kube-rbac-proxy/0.log"
Oct 29 23:29:16.352261 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.352230    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:16.387526 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.387498    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ctxl4_eb76746d-f3e8-418e-9d22-092d236c2a7d/init-textfile/0.log"
Oct 29 23:29:16.547093 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:16.547057    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:29:17.910970 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:17.910939    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-2f6l2_53686b8f-158b-4426-bb95-c80781ba7dd2/prometheus-operator/0.log"
Oct 29 23:29:18.008605 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.008573    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-2f6l2_53686b8f-158b-4426-bb95-c80781ba7dd2/kube-rbac-proxy/0.log"
Oct 29 23:29:18.113885 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.113852    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-gqkft_f573fdc2-667e-49f6-9ec8-6a0bbeb23ebf/prometheus-operator-admission-webhook/0.log"
Oct 29 23:29:18.240516 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.240463    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-9pjrl_3138ed5e-517d-41c5-8db4-e66c8e8ad523/manager/0.log"
Oct 29 23:29:18.350954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.350930    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j9gfc_761f5568-5049-4c79-b02c-9fd14fbe5009/kuadrant-console-plugin/0.log"
Oct 29 23:29:18.483807 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.483776    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-9pjrl_3138ed5e-517d-41c5-8db4-e66c8e8ad523/manager/0.log"
Oct 29 23:29:18.595805 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.595735    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-j9gfc_761f5568-5049-4c79-b02c-9fd14fbe5009/kuadrant-console-plugin/0.log"
Oct 29 23:29:18.638876 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.638846    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-kjkc2_f0cf0719-50ae-421c-8a9f-523a76cb1525/manager/0.log"
Oct 29 23:29:18.843364 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:18.843337    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-kjkc2_f0cf0719-50ae-421c-8a9f-523a76cb1525/manager/0.log"
Oct 29 23:29:20.598971 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:20.598932    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-qnzcj_e00a2559-ea47-4bde-9c63-a175add6c791/networking-console-plugin/0.log"
Oct 29 23:29:21.621222 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:21.621180    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/2.log"
Oct 29 23:29:21.628861 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:21.628834    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-nd299_a2bd555f-4524-41ef-900a-25b26103bec8/console-operator/3.log"
Oct 29 23:29:21.875892 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:21.875807    5044 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vz8b8/perf-node-gather-daemonset-jzvfc"
Oct 29 23:29:22.766619 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:22.766589    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6dd789c8b7-j8fs4_95feb768-13af-4cae-ad0e-6b797cfbe9a0/download-server/0.log"
Oct 29 23:29:23.989014 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:23.988982    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-bd4hn_03c6b963-7075-4411-9bc1-af2a05401cde/volume-data-source-validator/0.log"
Oct 29 23:29:26.521871 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:26.521165    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8lst_2ebf8680-3179-4d73-abac-d53520204010/dns/0.log"
Oct 29 23:29:26.618824 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:26.618797    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f8lst_2ebf8680-3179-4d73-abac-d53520204010/kube-rbac-proxy/0.log"
Oct 29 23:29:26.891954 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:26.891867    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-p785t_bd7459bb-db42-425e-8a89-16d3dfcd93d2/manager/0.log"
Oct 29 23:29:26.920709 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:26.920684    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-p785t_bd7459bb-db42-425e-8a89-16d3dfcd93d2/copy-manifests/0.log"
Oct 29 23:29:26.977245 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:26.977210    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-p785t_bd7459bb-db42-425e-8a89-16d3dfcd93d2/manager/0.log"
Oct 29 23:29:27.004896 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:27.004870    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-5588597fcf-p785t_bd7459bb-db42-425e-8a89-16d3dfcd93d2/copy-manifests/0.log"
Oct 29 23:29:27.037468 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:27.037443    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lw2vc_2e00bed0-7bc2-4322-b108-efb74a2ee6cd/dns-node-resolver/0.log"
Oct 29 23:29:27.471247 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:27.471211    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:28.117798 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.117771    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:28.123958 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.123932    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:28.235032 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.235002    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-module-controller-manager-7566cf5fc8-h6xw7_22cec7aa-978d-464a-a84f-9f0eb0d47c00/manager/0.log"
Oct 29 23:29:28.295509 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.295466    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:28.378403 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.378335    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-cfcc55999-2vhks_5730de6c-aa05-4430-b787-22d502b543b7/registry/0.log"
Oct 29 23:29:28.496719 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.496684    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:29:28.716523 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:28.716439    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qcbhg_8e4d414a-b040-4e77-9ddf-a37d04677415/node-ca/0.log"
Oct 29 23:29:29.792331 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:29.792301    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:29.873838 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:29.873805    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:30.635777 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.635748    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:30.637522 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.637469    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:30.708554 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.708518    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-858f55f4d96mbr2_d981ea82-7aae-4e46-8b3b-16eefae200ca/istio-proxy/0.log"
Oct 29 23:29:30.718935 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.718911    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:30.800866 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.800821    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:30.873387 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.873327    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:30.987573 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:30.987544    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:29:31.060100 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:31.060065    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:29:31.605501 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:31.604688    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:31.764554 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:31.764521    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:31.781530 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:31.781500    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d9897b54c-gg9rd_0840088d-bf2c-4a83-8452-45806526646c/istio-proxy/0.log"
Oct 29 23:29:31.961839 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:31.961756    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5d7cd8c56f-8gsnl_7f0c3a6a-b4fb-469f-9837-2f010a013a49/router/0.log"
Oct 29 23:29:32.111368 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:32.110979    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-6dd6bfb767-885vc_49a42b06-14b1-41fc-b997-1f82414ad628/istio-proxy/0.log"
Oct 29 23:29:32.246398 ip-10-0-134-8 kubenswrapper[5044]: I1029 23:29:32.246361    5044 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-5c68dfb46b-rxwzb_b3e08d67-cdc0-411b-b4d2-f4abd99f2498/manager/0.log"