Sep 11 21:05:30.197059 ip-10-0-129-37 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 21:05:30.637696 ip-10-0-129-37 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:05:30.637696 ip-10-0-129-37 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 21:05:30.637696 ip-10-0-129-37 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:05:30.637696 ip-10-0-129-37 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 21:05:30.637696 ip-10-0-129-37 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:05:30.638934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.638841    2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 21:05:30.643889 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643875    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:30.643889 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643889    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643893    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643896    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643899    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643902    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643905    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643908    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643910    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643913    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643917    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643920    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643923    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643925    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643928    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643930    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643933    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643936    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643938    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643941    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643943    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:30.643947 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643946    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643949    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643952    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643955    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643958    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643964    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643967    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643970    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643973    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643975    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643978    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643981    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643983    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643986    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643988    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643991    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643993    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643996    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.643998    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644001    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:30.644432 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644003    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644006    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644009    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644012    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644015    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644017    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644020    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644023    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644025    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644028    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644030    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644034    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644036    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644039    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644043    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644048    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644051    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644055    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644058    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:30.644973 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644061    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644064    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644067    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644069    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644072    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644075    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644077    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644080    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644082    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644085    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644087    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644091    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644094    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644098    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644102    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644105    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644108    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644111    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644114    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644117    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:30.645449 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644119    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644123    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644128    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644131    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644134    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644137    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644139    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644143    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644146    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644149    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644152    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644154    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644157    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644159    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644162    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644165    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644167    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644170    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:30.645941 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.644192    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:30.646800 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646777    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646801    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646805    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646809    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646812    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646815    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646818    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646821    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646823    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646826    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646829    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646832    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646835    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646837    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:30.646834 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646840    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646843    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646847    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646849    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646852    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646854    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646857    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646859    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646862    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646865    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646867    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646869    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646872    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646875    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646878    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646880    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646883    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646885    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646889    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646891    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:30.647270 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646893    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646896    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646898    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646901    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646905    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646909    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646912    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646915    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646917    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646920    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646923    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646926    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646928    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646931    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646934    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646936    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646939    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646942    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646944    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646947    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:30.647759 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646949    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646952    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646955    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646957    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646961    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646965    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646968    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646970    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646973    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646975    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646978    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646981    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646983    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646986    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646988    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646991    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646993    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.646996    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647000    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647002    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:30.648297 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647005    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647008    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647010    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647013    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647016    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647018    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647021    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647023    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647026    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647028    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647031    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647034    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647037    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647040    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647042    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647045    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647047    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647050    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647052    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647056    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:30.648812 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647059    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647062    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647065    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647068    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647071    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647418    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647424    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647426    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647429    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647432    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647435    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647438    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647441    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647444    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647447    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647450    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647453    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647455    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647458    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:30.649310 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647461    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647463    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647466    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647468    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647471    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647474    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647476    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647479    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647481    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647483    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647486    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647489    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647492    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647494    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647497    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647501    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647505    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647508    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647510    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647516    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:30.649818 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647519    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647522    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647525    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647528    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647530    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647534    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647538    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647541    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647544    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647547    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647549    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647552    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647554    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647557    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647559    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647562    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647564    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647567    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647569    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:30.650304 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647572    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647575    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647577    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647580    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647582    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647585    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647588    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647590    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647593    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647596    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647599    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647602    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647605    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647608    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647611    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647613    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647616    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647619    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647621    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:30.650757 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647624    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647628    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647631    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647634    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647637    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647640    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647643    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647646    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647648    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647651    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647653    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647656    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647658    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647661    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647663    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647666    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647668    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647672    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647675    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647677    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:30.651217 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647680    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647682    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647685    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647687    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647690    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647694    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.647696    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647780    2585 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647841    2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647848    2585 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647852    2585 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647856    2585 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647860    2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647865    2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647869    2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647872    2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647875    2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647879    2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647882    2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647885    2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647888    2585 flags.go:64] FLAG: --cgroup-root=""
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647891    2585 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647894    2585 flags.go:64] FLAG: --client-ca-file=""
Sep 11 21:05:30.651708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647897    2585 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647900    2585 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647905    2585 flags.go:64] FLAG: --cluster-domain=""
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647907    2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647910    2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647913    2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647918    2585 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647922    2585 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647925    2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647929    2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647932    2585 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647935    2585 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647938    2585 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647941    2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647945    2585 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647948    2585 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647952    2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647955    2585 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647958    2585 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647960    2585 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647964    2585 flags.go:64] FLAG: --enable-server="true"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647966    2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647970    2585 flags.go:64] FLAG: --event-burst="100"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647973    2585 flags.go:64] FLAG: --event-qps="50"
Sep 11 21:05:30.652264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647976    2585 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647979    2585 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647982    2585 flags.go:64] FLAG: --eviction-hard=""
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647986    2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647989    2585 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647991    2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647994    2585 flags.go:64] FLAG: --eviction-soft=""
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.647997    2585 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648000    2585 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648003    2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648005    2585 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648008    2585 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648011    2585 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648014    2585 flags.go:64] FLAG: --feature-gates=""
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648019    2585 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648022    2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648025    2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648028    2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648031    2585 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648034    2585 flags.go:64] FLAG: --help="false"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648037    2585 flags.go:64] FLAG: --hostname-override="ip-10-0-129-37.ec2.internal"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648040    2585 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648043    2585 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 21:05:30.652849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648046    2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648050    2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648053    2585 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648056    2585 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648059    2585 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648062    2585 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648065    2585 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648067    2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648070    2585 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648073    2585 flags.go:64] FLAG: --kube-reserved=""
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648076    2585 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648079    2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648082    2585 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648085    2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648088    2585 flags.go:64] FLAG: --lock-file=""
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648091    2585 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648094    2585 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648096    2585 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648102    2585 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648105    2585 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648107    2585 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648110    2585 flags.go:64] FLAG: --logging-format="text"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648113    2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648118    2585 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 21:05:30.653472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648120    2585 flags.go:64] FLAG: --manifest-url=""
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648123    2585 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648127    2585 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648130    2585 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648134    2585 flags.go:64] FLAG: --max-pods="110"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648137    2585 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648140    2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648143    2585 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648146    2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648149    2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648152    2585 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648155    2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648161    2585 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648164    2585 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648167    2585 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648170    2585 flags.go:64] FLAG: --pod-cidr=""
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648173    2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648178    2585 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648181    2585 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648184    2585 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648187    2585 flags.go:64] FLAG: --port="10250"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648190    2585 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648193    2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09f17b9fce5b5a7b3"
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648197    2585 flags.go:64] FLAG: --qos-reserved=""
Sep 11 21:05:30.654079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648200    2585 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648202    2585 flags.go:64] FLAG: --register-node="true"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648205    2585 flags.go:64] FLAG: --register-with-taints=""
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648209    2585 flags.go:64] FLAG: --registry-burst="10"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648212    2585 flags.go:64] FLAG: --registry-qps="5"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648214    2585 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648217    2585 flags.go:64] FLAG: --reserved-memory=""
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648222    2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648225    2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648229    2585 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648231    2585 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648234    2585 flags.go:64] FLAG: --runonce="false"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648237    2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648240    2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648243    2585 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648246    2585 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648249    2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648252    2585 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648255    2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648258    2585 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648261    2585 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648264    2585 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648267    2585 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648270    2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648273    2585 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 21:05:30.654658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648276    2585 flags.go:64] FLAG: --system-cgroups=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648278    2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648284    2585 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648286    2585 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648289    2585 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648293    2585 flags.go:64] FLAG: --tls-min-version=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648296    2585 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648299    2585 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648303    2585 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648306    2585 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648309    2585 flags.go:64] FLAG: --v="2"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648313    2585 flags.go:64] FLAG: --version="false"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648320    2585 flags.go:64] FLAG: --vmodule=""
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648323    2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.648327    2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648447    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648451    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648454    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648457    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648460    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648463    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648466    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648468    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:30.655276 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648471    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648474    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648476    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648479    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648481    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648484    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648487    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648491    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648494    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648497    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648500    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648502    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648505    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648507    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648510    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648512    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648515    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648518    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648521    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648524    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:30.655848 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648526    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648529    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648531    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648534    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648538    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648541    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648544    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648546    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648549    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648551    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648554    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648556    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648559    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648563    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648567    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648570    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648573    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648575    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648578    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:30.656336 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648580    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648583    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648586    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648588    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648591    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648593    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648596    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648599    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648601    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648604    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648607    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648609    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648614    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648617    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648620    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648623    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648626    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648630    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648632    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:30.656817 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648635    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648637    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648640    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648643    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648645    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648648    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648650    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648653    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648656    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648658    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648661    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648663    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648666    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648668    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648671    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648673    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648676    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648678    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648681    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648684    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:30.657311 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648686    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648688    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648691    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648693    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648696    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648699    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648701    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648704    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648707    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648709    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648713    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648716    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.648718    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.649464    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.657052    2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 21:05:30.657833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.657065    2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.657937    2585 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.657945    2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658013    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658019    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658024    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658027    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658031    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658035    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658038    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658041    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658044    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658047    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658049    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658052    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658055    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658057    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658060    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658063    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:30.658205 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658065    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658068    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658071    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658076    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658079    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658082    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658085    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658088    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658090    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658093    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658096    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658099    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658101    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658104    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658106    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658110    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658112    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658115    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658118    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:30.658678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658121    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658124    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658127    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658130    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658132    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658135    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658137    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658140    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658143    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658145    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658149    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658151    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658154    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658157    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658159    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658162    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658170    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658173    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658176    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658178    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:30.659159 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658180    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658183    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658186    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658188    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658192    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658194    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658197    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658199    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658202    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658205    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658208    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658210    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658213    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658216    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658219    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658221    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658224    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658226    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658229    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658231    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:30.659641 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658234    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658236    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658239    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658241    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658244    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658246    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658249    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658251    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658253    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658261    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658264    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658267    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658269    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658273    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658276    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658279    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658282    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658285    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658288    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:30.660137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658291    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658294    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658297    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658299    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658302    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.658307    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658442    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658447    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658450    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658452    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658455    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658458    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658461    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658463    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658466    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:05:30.660622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658468    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658472    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658476    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658479    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658482    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658484    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658488    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658490    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658498    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658501    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658504    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658506    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658509    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658511    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658514    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658517    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658519    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658522    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658524    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:05:30.661108 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658527    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658530    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658532    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658535    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658538    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658540    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658543    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658545    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658548    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658550    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658553    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658555    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658558    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658560    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658563    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658565    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658568    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658570    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658573    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658575    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658578    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:05:30.661574 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658580    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658589    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658592    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658595    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658597    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658600    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658603    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658606    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658608    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658612    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658615    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658619    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658622    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658625    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658628    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658630    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658632    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658635    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658637    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:05:30.662107 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658640    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658643    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658645    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658648    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658650    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658653    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658655    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658658    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658660    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658663    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658665    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658668    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658670    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658673    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658675    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658683    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658687    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658689    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658692    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658694    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:05:30.662559 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658697    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658699    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658702    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658704    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658707    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658709    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658712    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658714    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658716    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658719    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:30.658721    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.658726    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.658823    2585 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.661107    2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 21:05:30.663057 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.662177    2585 server.go:1019] "Starting client certificate rotation"
Sep 11 21:05:30.663401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.662293    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:05:30.663401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.663123    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:05:30.665122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.665110    2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:05:30.666367 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.666339    2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:05:30.678747 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.678730    2585 log.go:25] "Validated CRI v1 runtime API"
Sep 11 21:05:30.682134 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.682114    2585 log.go:25] "Validated CRI v1 image API"
Sep 11 21:05:30.683003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.682985    2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 21:05:30.686530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.686507    2585 fs.go:135] Filesystem UUIDs: map[6c2de91d-c439-4843-8872-8fef6c7e4e19:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e9d3d012-b28d-4cd2-bded-300f1b6176e4:/dev/nvme0n1p4]
Sep 11 21:05:30.686601 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.686529    2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 21:05:30.691384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.691284    2585 manager.go:216] Machine: {Timestamp:2026-09-11 21:05:30.690041438 +0000 UTC m=+0.366406820 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110303 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bcc6f1e351c8d8815df2cafc46a35 SystemUUID:ec2bcc6f-1e35-1c8d-8815-df2cafc46a35 BootID:1e53e5ce-8537-4443-82fd-c1bc796839ff Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:45:0e:a9:7a:c9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:45:0e:a9:7a:c9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:12:65:4c:8d:97 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 21:05:30.691384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.691382    2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 21:05:30.691480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.691451    2585 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 21:05:30.694955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.694929    2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 21:05:30.695073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.694957    2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 21:05:30.695868 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.695859    2585 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 21:05:30.695907 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.695870    2585 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 21:05:30.695907 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.695882    2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:05:30.695907 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.695895    2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:05:30.696170 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.696144    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:05:30.697161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.697148    2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 21:05:30.701781 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.701767    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:05:30.701933 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.701922    2585 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 21:05:30.701990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.701958    2585 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 21:05:30.701990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.701978    2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 21:05:30.702089 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.702035    2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 21:05:30.702089 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.702075    2585 kubelet.go:398] "Adding apiserver pod source"
Sep 11 21:05:30.702178 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.702091    2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 21:05:30.702493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.702481    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:05:30.702544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.702502    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:05:30.704914 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.704898    2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 21:05:30.707184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.707171    2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 21:05:30.707233 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.707202    2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 21:05:30.709193 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709177    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709199    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709208    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709217    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709230    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709237    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709254    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709261    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709268    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 21:05:30.709269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709273    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 21:05:30.709515 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709282    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 21:05:30.709515 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.709287    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 21:05:30.710192 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.710182    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 21:05:30.710192 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.710191    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 21:05:30.713193 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.713176    2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 21:05:30.714256 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.714231    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 21:05:30.714301 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.714243    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 21:05:30.715234 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.715222    2585 server.go:1268] "Started kubelet"
Sep 11 21:05:30.715295 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.715257    2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 21:05:30.715620 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.715408    2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 21:05:30.715938 ip-10-0-129-37 systemd[1]: Started Kubernetes Kubelet.
Sep 11 21:05:30.720869 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.720834    2585 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 21:05:30.722598 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.722569    2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 21:05:30.722994 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.722953    2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 21:05:30.723093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.723080    2585 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 21:05:30.726501 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.725467    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d46034885b90d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.71519765 +0000 UTC m=+0.391563031,LastTimestamp:2026-09-11 21:05:30.71519765 +0000 UTC m=+0.391563031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.728927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.728909    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 21:05:30.729632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.729612    2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 21:05:30.729728 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.729698    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:30.730331 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730314    2585 factory.go:55] Registering systemd factory
Sep 11 21:05:30.730331 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730333    2585 factory.go:223] Registration of the systemd container factory successfully
Sep 11 21:05:30.730452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730366    2585 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 21:05:30.730452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730381    2585 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 21:05:30.730452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730368    2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 21:05:30.730557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730479    2585 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 21:05:30.730557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730487    2585 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 21:05:30.730557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730554    2585 factory.go:153] Registering CRI-O factory
Sep 11 21:05:30.730652 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730565    2585 factory.go:223] Registration of the crio container factory successfully
Sep 11 21:05:30.730652 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730603    2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 21:05:30.730652 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730615    2585 factory.go:103] Registering Raw factory
Sep 11 21:05:30.730652 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.730624    2585 manager.go:1196] Started watching for new ooms in manager
Sep 11 21:05:30.731114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.731099    2585 manager.go:349] Starting recovery of all containers
Sep 11 21:05:30.739657 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.739638    2585 manager.go:354] Recovery completed
Sep 11 21:05:30.740986 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.740951    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 21:05:30.741085 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.741062    2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 21:05:30.745145 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.744798    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:30.746160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.746142    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jmvdd"
Sep 11 21:05:30.753267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753250    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:30.753347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753292    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:30.753347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753303    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:30.753857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753842    2585 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 21:05:30.753941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753859    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:30.753941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753857    2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 21:05:30.753941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.753893    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:05:30.754194 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.754177    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jmvdd"
Sep 11 21:05:30.755679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.755662    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:30.755763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.755686    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:30.755763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.755701    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:30.763288 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.763223    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d460348aa072cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.753266381 +0000 UTC m=+0.429631768,LastTimestamp:2026-09-11 21:05:30.753266381 +0000 UTC m=+0.429631768,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.772982 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.772923    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d460348aa0ee46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-37.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.75329799 +0000 UTC m=+0.429663372,LastTimestamp:2026-09-11 21:05:30.75329799 +0000 UTC m=+0.429663372,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.782015 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.781953    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d460348aa10fa6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-37.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.753306534 +0000 UTC m=+0.429671915,LastTimestamp:2026-09-11 21:05:30.753306534 +0000 UTC m=+0.429671915,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.793396    2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-37.ec2.internal.18d460348aa072cd\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d460348aa072cd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-37.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.753266381 +0000 UTC m=+0.429631768,LastTimestamp:2026-09-11 21:05:30.755676488 +0000 UTC m=+0.432041871,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.793516    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.794725    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.794777    2585 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.794816    2585 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.794859    2585 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.801537    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.801545    2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-37.ec2.internal.18d460348aa0ee46\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d460348aa0ee46  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-37.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.75329799 +0000 UTC m=+0.429663372,LastTimestamp:2026-09-11 21:05:30.755692777 +0000 UTC m=+0.432058166,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.811554    2585 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-37.ec2.internal.18d460348aa10fa6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-37.ec2.internal.18d460348aa10fa6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-37.ec2.internal,UID:ip-10-0-129-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-37.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-37.ec2.internal,},FirstTimestamp:2026-09-11 21:05:30.753306534 +0000 UTC m=+0.429671915,LastTimestamp:2026-09-11 21:05:30.755705837 +0000 UTC m=+0.432071222,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-37.ec2.internal,}"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.830697    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.894613    2585 policy_none.go:49] "None policy: Start"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.894634    2585 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 21:05:30.895604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.894649    2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 21:05:30.896059 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.895819    2585 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Sep 11 21:05:30.896840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.896827    2585 policy_none.go:47] "Start"
Sep 11 21:05:30.928271 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928256    2585 manager.go:337] "Starting Device Plugin manager"
Sep 11 21:05:30.928345 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.928287    2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 21:05:30.928345 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928297    2585 server.go:87] "Starting device plugin registration server"
Sep 11 21:05:30.928610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928596    2585 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 21:05:30.928695 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928612    2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 21:05:30.928755 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928700    2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 21:05:30.928819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928798    2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 21:05:30.928819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:30.928808    2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 21:05:30.929335 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.929311    2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 21:05:30.929431 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.929360    2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:30.946417 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:30.946399    2585 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-37.ec2.internal\" not found" node="ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.029542 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.029524    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:31.030355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.030340    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:31.030420 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.030368    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:31.030420 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.030383    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:31.030420 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.030410    2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.039212 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.039198    2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.039254 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.039217    2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-37.ec2.internal\": node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:31.066329 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.066312    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:31.096410 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.096392    2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"]
Sep 11 21:05:31.096472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.096463    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:31.097946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.097933    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:31.098005 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.097959    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:31.098005 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.097972    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:31.100390 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.100378    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:31.100523 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.100509    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.100573 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.100538    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:31.101509 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.101484    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:31.101591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.101513    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:31.101591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.101523    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:31.101591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.101484    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:31.101696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.101594    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:31.101696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.101607    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:31.103918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.103902    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.104007 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.103927    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:31.104711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.104698    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:31.104776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.104721    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:31.104776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.104730    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:31.121294 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.121274    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-37.ec2.internal\" not found" node="ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.124997 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.124983    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-37.ec2.internal\" not found" node="ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.131996 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.131981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5723e815bf040e5d45b5f45f3fe46312-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal\" (UID: \"5723e815bf040e5d45b5f45f3fe46312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.132048 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.132003    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5723e815bf040e5d45b5f45f3fe46312-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal\" (UID: \"5723e815bf040e5d45b5f45f3fe46312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.132048 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.132018    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6abc4d8c8ce3d693c97b0f59444f7f92-config\") pod \"kube-apiserver-proxy-ip-10-0-129-37.ec2.internal\" (UID: \"6abc4d8c8ce3d693c97b0f59444f7f92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.167107 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.167059    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:31.232563 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.232540    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5723e815bf040e5d45b5f45f3fe46312-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal\" (UID: \"5723e815bf040e5d45b5f45f3fe46312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.232636 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.232570    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6abc4d8c8ce3d693c97b0f59444f7f92-config\") pod \"kube-apiserver-proxy-ip-10-0-129-37.ec2.internal\" (UID: \"6abc4d8c8ce3d693c97b0f59444f7f92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.232636 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.232587    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5723e815bf040e5d45b5f45f3fe46312-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal\" (UID: \"5723e815bf040e5d45b5f45f3fe46312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.232636 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.232619    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5723e815bf040e5d45b5f45f3fe46312-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal\" (UID: \"5723e815bf040e5d45b5f45f3fe46312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.232636 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.232623    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5723e815bf040e5d45b5f45f3fe46312-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal\" (UID: \"5723e815bf040e5d45b5f45f3fe46312\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.232764 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.232636    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6abc4d8c8ce3d693c97b0f59444f7f92-config\") pod \"kube-apiserver-proxy-ip-10-0-129-37.ec2.internal\" (UID: \"6abc4d8c8ce3d693c97b0f59444f7f92\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.267679 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.267652    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:31.368127 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:31.368098    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:31.424309 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.424255    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:31.429615 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:31.429501    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:32.553703 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:32.553682    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:32.654206 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:32.654172    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:32.746651 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.746615    2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 21:05:32.754903 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:32.754884    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:32.855034 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:32.854961    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:32.868504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.868486    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:32.911107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.911089    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:05:32.912115 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.912099    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:05:32.912182 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.912128    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:05:32.912182 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.912138    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:05:32.955269 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:32.955238    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:32.963387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.963370    2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:32.983625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.983600    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 21:00:31 +0000 UTC" deadline="2028-02-22 11:29:39.554932659 +0000 UTC"
Sep 11 21:05:32.983625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:32.983623    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12686h24m6.571312773s"
Sep 11 21:05:33.056100 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.056080    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:33.156618 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.156565    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-37.ec2.internal\" not found"
Sep 11 21:05:33.194177 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.194151    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:33.231696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.231673    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:05:33.315415 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.315266    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:33.328815 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.328796    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:05:33.329891 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.329879    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal"
Sep 11 21:05:33.337196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.337173    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:05:33.343932 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:33.343905    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abc4d8c8ce3d693c97b0f59444f7f92.slice/crio-cfc77ad2ca2fac712b5a9bbf29e93e319d9d83ac8bb5f190054cadd83aad5a72 WatchSource:0}: Error finding container cfc77ad2ca2fac712b5a9bbf29e93e319d9d83ac8bb5f190054cadd83aad5a72: Status 404 returned error can't find the container with id cfc77ad2ca2fac712b5a9bbf29e93e319d9d83ac8bb5f190054cadd83aad5a72
Sep 11 21:05:33.344151 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:33.344134    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5723e815bf040e5d45b5f45f3fe46312.slice/crio-7656e058416f674e68af95f97420a27f96af9b322a6d1ac10a04c5967790762a WatchSource:0}: Error finding container 7656e058416f674e68af95f97420a27f96af9b322a6d1ac10a04c5967790762a: Status 404 returned error can't find the container with id 7656e058416f674e68af95f97420a27f96af9b322a6d1ac10a04c5967790762a
Sep 11 21:05:33.349157 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.349132    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:05:33.788403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.788380    2585 apiserver.go:52] "Watching apiserver"
Sep 11 21:05:33.795106 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.795090    2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 21:05:33.796498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.796474    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal","openshift-multus/multus-cc287","openshift-multus/network-metrics-daemon-rm2zj","openshift-cluster-node-tuning-operator/tuned-vhn7v","openshift-dns/node-resolver-tdx6l","openshift-multus/multus-additional-cni-plugins-pbxxn","openshift-network-diagnostics/network-check-target-7w4fr","openshift-network-operator/iptables-alerter-2wsdz","openshift-ovn-kubernetes/ovnkube-node-xhqsv","kube-system/global-pull-secret-syncer-dz4bj","kube-system/konnectivity-agent-75tz9","kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t","openshift-image-registry/node-ca-dmszh"]
Sep 11 21:05:33.800226 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.800205    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:33.800300 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.800267    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:33.802250 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.802224    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.804290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.804268    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.804290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.804285    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xf542\""
Sep 11 21:05:33.804438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.804326    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 21:05:33.804494 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.804466    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.804545 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.804510    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:33.804594 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.804565    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:33.806809 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.806795    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.808533 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.808519    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.808756 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.808737    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q8xbd\""
Sep 11 21:05:33.808865 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.808850    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.808969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.808953    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.810808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.810788    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.810944 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.810913    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qzc66\""
Sep 11 21:05:33.811128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.811115    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.811262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.811246    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.813097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813080    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 21:05:33.813191 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813176    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 21:05:33.813562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813541    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.813562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813556    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 21:05:33.813726 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813627    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tmkkr\""
Sep 11 21:05:33.813726 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813551    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.813897 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.813881    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.814097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.814079    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 21:05:33.815869 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.815843    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.815973 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.815895    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.816036 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.815851    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 21:05:33.816353 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.816328    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.816704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.816688    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcb92\""
Sep 11 21:05:33.816761 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.816702    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 21:05:33.816761 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.816695    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 21:05:33.817230 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.817217    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 21:05:33.818187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.818170    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.819082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.819061    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.819220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.819196    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.819278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.819250    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 21:05:33.820168 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.820140    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xfxkc\""
Sep 11 21:05:33.820816 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.820796    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 21:05:33.821723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.821676    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pjmdx\""
Sep 11 21:05:33.823080 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.823052    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:33.823450 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.823425    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:33.825700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825679    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.825778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825706    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf57l\" (UniqueName: \"kubernetes.io/projected/79192859-1f89-4395-b14a-e52bee7a6950-kube-api-access-jf57l\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.825778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825716    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:33.825778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825721    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-socket-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.825906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825805    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-device-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.825906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825831    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-sys\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.825906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825855    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysctl-conf\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.825906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825878    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-log-socket\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.825906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825899    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-modprobe-d\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825921    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-lib-modules\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825943    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cni-binary-copy\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.825977    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-system-cni-dir\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826000    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovn-node-metrics-cert\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826041    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63642ec5-6d06-4d2b-aff5-51465eade3a6-tmp\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826057    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5g8\" (UniqueName: \"kubernetes.io/projected/63642ec5-6d06-4d2b-aff5-51465eade3a6-kube-api-access-hq5g8\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826105    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-systemd-units\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826136    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-etc-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826159    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-env-overrides\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826183    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5zsf\" (UniqueName: \"kubernetes.io/projected/d7434344-3ab9-4250-9f03-d548af3bb9a4-kube-api-access-c5zsf\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826208    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-run\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826228    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79192859-1f89-4395-b14a-e52bee7a6950-tmp-dir\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826262    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826288    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-run-netns\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826333    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-var-lib-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-host\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826399    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826424    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826446    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-systemd\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826468    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-node-log\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826506    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovnkube-script-lib\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826529    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826554    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysctl-d\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826581    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-registration-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826603    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826626    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826668    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-serviceca\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826696    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rl5\" (UniqueName: \"kubernetes.io/projected/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-kube-api-access-n8rl5\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826731    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysconfig\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826756    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-host\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826770    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-tuned\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-sys-fs\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826824    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cnibin\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826847    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-ovn\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826878    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovnkube-config\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826903    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.826940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826923    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79192859-1f89-4395-b14a-e52bee7a6950-hosts-file\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826937    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-kubernetes\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826950    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-systemd\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826970    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-kubelet\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.826991    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-cni-netd\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827009    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49nnl\" (UniqueName: \"kubernetes.io/projected/1a457fc6-a504-442e-9933-c616c05738ad-kube-api-access-49nnl\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827046    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tmvp\" (UniqueName: \"kubernetes.io/projected/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-kube-api-access-4tmvp\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827073    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827100    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cb4d\" (UniqueName: \"kubernetes.io/projected/001078c7-c95f-4cb5-922c-d4ee0f1beecf-kube-api-access-8cb4d\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827118    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-slash\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827142    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-var-lib-kubelet\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827171    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-cni-bin\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.827437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827208    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.827803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827668    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 21:05:33.827803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827755    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mtxvm\""
Sep 11 21:05:33.827803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.827772    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 21:05:33.828498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.828090    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:33.830416 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.830399    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 21:05:33.830670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.830655    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 21:05:33.830726 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.830714    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hx7qn\""
Sep 11 21:05:33.830819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.830803    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:05:33.832876 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.832861    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:05:33.855856 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.855841    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v2b4w"
Sep 11 21:05:33.863300 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.863287    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v2b4w"
Sep 11 21:05:33.883719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.883689    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal" event={"ID":"5723e815bf040e5d45b5f45f3fe46312","Type":"ContainerStarted","Data":"7656e058416f674e68af95f97420a27f96af9b322a6d1ac10a04c5967790762a"}
Sep 11 21:05:33.884711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.884690    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal" event={"ID":"6abc4d8c8ce3d693c97b0f59444f7f92","Type":"ContainerStarted","Data":"cfc77ad2ca2fac712b5a9bbf29e93e319d9d83ac8bb5f190054cadd83aad5a72"}
Sep 11 21:05:33.916029 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.916006    2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 21:05:33.928379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928355    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928382    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-system-cni-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.928473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928408    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-k8s-cni-cncf-io\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.928473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928424    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79192859-1f89-4395-b14a-e52bee7a6950-hosts-file\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.928473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928439    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-kubernetes\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.928473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928453    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-systemd\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.928473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928463    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928474    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-kubelet\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928496    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-cni-netd\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928505    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/79192859-1f89-4395-b14a-e52bee7a6950-hosts-file\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928520    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49nnl\" (UniqueName: \"kubernetes.io/projected/1a457fc6-a504-442e-9933-c616c05738ad-kube-api-access-49nnl\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928529    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-systemd\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928537    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-kubelet\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928543    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1de3c338-5441-4be4-a5b9-10645947fc29-kubelet-config\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928553    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-kubernetes\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928553    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-cni-netd\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928582    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928618    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tmvp\" (UniqueName: \"kubernetes.io/projected/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-kube-api-access-4tmvp\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928659    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928680    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb4d\" (UniqueName: \"kubernetes.io/projected/001078c7-c95f-4cb5-922c-d4ee0f1beecf-kube-api-access-8cb4d\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928714    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-slash\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.928767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928755    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-slash\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928825    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf736d5-b745-40a7-87c8-c717499d60ab-iptables-alerter-script\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928859    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf736d5-b745-40a7-87c8-c717499d60ab-host-slash\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928886    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-var-lib-kubelet\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928913    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-cni-bin\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928940    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-var-lib-kubelet\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.928965    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-cni-bin\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929002    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929030    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929056    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929058    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-conf-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929118    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrpj\" (UniqueName: \"kubernetes.io/projected/a137b21b-063b-4b9a-8b87-7a5e550cb98e-kube-api-access-7vrpj\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929147    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf57l\" (UniqueName: \"kubernetes.io/projected/79192859-1f89-4395-b14a-e52bee7a6950-kube-api-access-jf57l\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929170    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-socket-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929195    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-device-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929222    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-sys\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929246    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-netns\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.929304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929268    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/658ea950-2c87-4b61-94f3-cd9dd8725957-konnectivity-ca\") pod \"konnectivity-agent-75tz9\" (UID: \"658ea950-2c87-4b61-94f3-cd9dd8725957\") " pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929283    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-device-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929292    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysctl-conf\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929287    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929328    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-log-socket\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929333    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-sys\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929287    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-socket-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929362    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-modprobe-d\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929365    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-log-socket\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929414    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-lib-modules\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929435    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cni-binary-copy\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929471    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysctl-conf\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929468    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-socket-dir-parent\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929474    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-modprobe-d\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929515    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-kubelet\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929529    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929557    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-lib-modules\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929620    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-etc-kubernetes\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1de3c338-5441-4be4-a5b9-10645947fc29-dbus\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929695    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-system-cni-dir\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929721    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovn-node-metrics-cert\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929752    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63642ec5-6d06-4d2b-aff5-51465eade3a6-tmp\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929757    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-system-cni-dir\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929777    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5g8\" (UniqueName: \"kubernetes.io/projected/63642ec5-6d06-4d2b-aff5-51465eade3a6-kube-api-access-hq5g8\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929802    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-systemd-units\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929826    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-etc-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929862    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-systemd-units\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929875    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-etc-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929888    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-env-overrides\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929907    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5zsf\" (UniqueName: \"kubernetes.io/projected/d7434344-3ab9-4250-9f03-d548af3bb9a4-kube-api-access-c5zsf\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929932    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-cni-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929955    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a137b21b-063b-4b9a-8b87-7a5e550cb98e-cni-binary-copy\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929972    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cni-binary-copy\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.929978    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-hostroot\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.930866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930002    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/658ea950-2c87-4b61-94f3-cd9dd8725957-agent-certs\") pod \"konnectivity-agent-75tz9\" (UID: \"658ea950-2c87-4b61-94f3-cd9dd8725957\") " pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930025    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-run\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930048    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79192859-1f89-4395-b14a-e52bee7a6950-tmp-dir\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930087    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930160    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-run-netns\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930189    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-var-lib-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930212    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-host\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930224    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-run\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930240    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930228    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930269    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-cni-bin\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930272    2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930299    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930307    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-host\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930323    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-env-overrides\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930349    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930350    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-systemd\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930357    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-run-netns\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.931536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930371    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-var-lib-openvswitch\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.930383    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930403    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-systemd\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930407    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79192859-1f89-4395-b14a-e52bee7a6950-tmp-dir\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.930464    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:05:34.430429484 +0000 UTC m=+3.021942810 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930484    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-node-log\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930514    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovnkube-script-lib\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930502    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-node-log\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930543    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930572    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-cnibin\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930591    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-cni-multus\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930633    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysctl-d\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930688    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-registration-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930710    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930732    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930756    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-serviceca\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930763    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysctl-d\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.932369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930772    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-registration-dir\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930780    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rl5\" (UniqueName: \"kubernetes.io/projected/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-kube-api-access-n8rl5\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930808    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-etc-selinux\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930814    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysconfig\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930843    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-host\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930856    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-sysconfig\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930863    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-tuned\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930809    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930913    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/63642ec5-6d06-4d2b-aff5-51465eade3a6-host\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931037    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovnkube-script-lib\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931211    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-serviceca\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.930887    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-daemon-config\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-multus-certs\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931385    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz6gp\" (UniqueName: \"kubernetes.io/projected/bcf736d5-b745-40a7-87c8-c717499d60ab-kube-api-access-sz6gp\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931407    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-sys-fs\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931441    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cnibin\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931461    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-ovn\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.933205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931483    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovnkube-config\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.933954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931487    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-sys-fs\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.933954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931526    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/001078c7-c95f-4cb5-922c-d4ee0f1beecf-cnibin\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.933954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931552    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7434344-3ab9-4250-9f03-d548af3bb9a4-run-ovn\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.933954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.931977    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovnkube-config\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.934071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.933978    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/63642ec5-6d06-4d2b-aff5-51465eade3a6-etc-tuned\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.934071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.934003    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63642ec5-6d06-4d2b-aff5-51465eade3a6-tmp\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.934071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.934019    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7434344-3ab9-4250-9f03-d548af3bb9a4-ovn-node-metrics-cert\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:33.937213 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.937189    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:33.937310 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.937222    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:33.937310 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.937253    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:33.937432 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:33.937324    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:34.437304474 +0000 UTC m=+3.028817797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:33.939008 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.938984    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf57l\" (UniqueName: \"kubernetes.io/projected/79192859-1f89-4395-b14a-e52bee7a6950-kube-api-access-jf57l\") pod \"node-resolver-tdx6l\" (UID: \"79192859-1f89-4395-b14a-e52bee7a6950\") " pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:33.939146 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.939128    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tmvp\" (UniqueName: \"kubernetes.io/projected/c859a7ff-bb48-4de5-87d4-daa5cf3f9b33-kube-api-access-4tmvp\") pod \"aws-ebs-csi-driver-node-hhc5t\" (UID: \"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:33.941680 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.941658    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49nnl\" (UniqueName: \"kubernetes.io/projected/1a457fc6-a504-442e-9933-c616c05738ad-kube-api-access-49nnl\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:33.942130 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.942110    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cb4d\" (UniqueName: \"kubernetes.io/projected/001078c7-c95f-4cb5-922c-d4ee0f1beecf-kube-api-access-8cb4d\") pod \"multus-additional-cni-plugins-pbxxn\" (UID: \"001078c7-c95f-4cb5-922c-d4ee0f1beecf\") " pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:33.942248 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.942220    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rl5\" (UniqueName: \"kubernetes.io/projected/ae1c9348-76bf-4b45-90a0-35d9aa36cfe7-kube-api-access-n8rl5\") pod \"node-ca-dmszh\" (UID: \"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7\") " pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:33.942778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.942760    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5g8\" (UniqueName: \"kubernetes.io/projected/63642ec5-6d06-4d2b-aff5-51465eade3a6-kube-api-access-hq5g8\") pod \"tuned-vhn7v\" (UID: \"63642ec5-6d06-4d2b-aff5-51465eade3a6\") " pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:33.943459 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:33.943442    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5zsf\" (UniqueName: \"kubernetes.io/projected/d7434344-3ab9-4250-9f03-d548af3bb9a4-kube-api-access-c5zsf\") pod \"ovnkube-node-xhqsv\" (UID: \"d7434344-3ab9-4250-9f03-d548af3bb9a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:34.032511 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032476    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-conf-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032511 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032508    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrpj\" (UniqueName: \"kubernetes.io/projected/a137b21b-063b-4b9a-8b87-7a5e550cb98e-kube-api-access-7vrpj\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032525    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-netns\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032539    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/658ea950-2c87-4b61-94f3-cd9dd8725957-konnectivity-ca\") pod \"konnectivity-agent-75tz9\" (UID: \"658ea950-2c87-4b61-94f3-cd9dd8725957\") " pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032582    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-conf-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032599    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-netns\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032672    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-socket-dir-parent\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032707    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-kubelet\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032725    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-etc-kubernetes\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032739    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1de3c338-5441-4be4-a5b9-10645947fc29-dbus\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.032753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032744    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-socket-dir-parent\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032768    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-cni-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032801    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a137b21b-063b-4b9a-8b87-7a5e550cb98e-cni-binary-copy\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032831    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-hostroot\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032854    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/658ea950-2c87-4b61-94f3-cd9dd8725957-agent-certs\") pod \"konnectivity-agent-75tz9\" (UID: \"658ea950-2c87-4b61-94f3-cd9dd8725957\") " pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032876    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-etc-kubernetes\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032881    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-hostroot\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032882    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1de3c338-5441-4be4-a5b9-10645947fc29-dbus\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032897    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-cni-bin\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032924    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-kubelet\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032964    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-cni-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032974    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-cnibin\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.032999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-cni-multus\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033036    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-daemon-config\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033040    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-cni-bin\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033061    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-multus-certs\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033065    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-var-lib-cni-multus\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033086    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz6gp\" (UniqueName: \"kubernetes.io/projected/bcf736d5-b745-40a7-87c8-c717499d60ab-kube-api-access-sz6gp\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.033155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033100    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-cnibin\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033111    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-multus-certs\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033112    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/658ea950-2c87-4b61-94f3-cd9dd8725957-konnectivity-ca\") pod \"konnectivity-agent-75tz9\" (UID: \"658ea950-2c87-4b61-94f3-cd9dd8725957\") " pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033115    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-system-cni-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033152    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-k8s-cni-cncf-io\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033158    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-system-cni-dir\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033175    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1de3c338-5441-4be4-a5b9-10645947fc29-kubelet-config\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033198    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033217    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf736d5-b745-40a7-87c8-c717499d60ab-iptables-alerter-script\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033231    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf736d5-b745-40a7-87c8-c717499d60ab-host-slash\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033236    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1de3c338-5441-4be4-a5b9-10645947fc29-kubelet-config\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033196    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a137b21b-063b-4b9a-8b87-7a5e550cb98e-host-run-k8s-cni-cncf-io\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.033345    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033387    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a137b21b-063b-4b9a-8b87-7a5e550cb98e-cni-binary-copy\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033420    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcf736d5-b745-40a7-87c8-c717499d60ab-host-slash\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.033468    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:34.533449683 +0000 UTC m=+3.124962998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033560    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a137b21b-063b-4b9a-8b87-7a5e550cb98e-multus-daemon-config\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.033832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.033785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bcf736d5-b745-40a7-87c8-c717499d60ab-iptables-alerter-script\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.035201 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.035185    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/658ea950-2c87-4b61-94f3-cd9dd8725957-agent-certs\") pod \"konnectivity-agent-75tz9\" (UID: \"658ea950-2c87-4b61-94f3-cd9dd8725957\") " pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:34.048526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.048469    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrpj\" (UniqueName: \"kubernetes.io/projected/a137b21b-063b-4b9a-8b87-7a5e550cb98e-kube-api-access-7vrpj\") pod \"multus-cc287\" (UID: \"a137b21b-063b-4b9a-8b87-7a5e550cb98e\") " pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.051243 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.051227    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz6gp\" (UniqueName: \"kubernetes.io/projected/bcf736d5-b745-40a7-87c8-c717499d60ab-kube-api-access-sz6gp\") pod \"iptables-alerter-2wsdz\" (UID: \"bcf736d5-b745-40a7-87c8-c717499d60ab\") " pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.111336 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.111298    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t"
Sep 11 21:05:34.117806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.117784    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vhn7v"
Sep 11 21:05:34.121483 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.121448    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc859a7ff_bb48_4de5_87d4_daa5cf3f9b33.slice/crio-dc7a0be100d73b1111d09012d425ce4fdd41615bc2f3042c90d9e035e38d7449 WatchSource:0}: Error finding container dc7a0be100d73b1111d09012d425ce4fdd41615bc2f3042c90d9e035e38d7449: Status 404 returned error can't find the container with id dc7a0be100d73b1111d09012d425ce4fdd41615bc2f3042c90d9e035e38d7449
Sep 11 21:05:34.125462 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.125443    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63642ec5_6d06_4d2b_aff5_51465eade3a6.slice/crio-bf7b070c759efd812ec191386af0973eb674a20c5d957d40e6609004e8929663 WatchSource:0}: Error finding container bf7b070c759efd812ec191386af0973eb674a20c5d957d40e6609004e8929663: Status 404 returned error can't find the container with id bf7b070c759efd812ec191386af0973eb674a20c5d957d40e6609004e8929663
Sep 11 21:05:34.126228 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.126211    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tdx6l"
Sep 11 21:05:34.131491 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.131472    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pbxxn"
Sep 11 21:05:34.135352 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.135331    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79192859_1f89_4395_b14a_e52bee7a6950.slice/crio-5e37120e86455f992e5ed81f8e2aca5e95898dcf00207c211fa5bd779c2d9463 WatchSource:0}: Error finding container 5e37120e86455f992e5ed81f8e2aca5e95898dcf00207c211fa5bd779c2d9463: Status 404 returned error can't find the container with id 5e37120e86455f992e5ed81f8e2aca5e95898dcf00207c211fa5bd779c2d9463
Sep 11 21:05:34.136030 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.136015    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:34.139530 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.139514    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001078c7_c95f_4cb5_922c_d4ee0f1beecf.slice/crio-86727dca462e314342c02abaf77804cc208c119c3ab671756faba669a91950b7 WatchSource:0}: Error finding container 86727dca462e314342c02abaf77804cc208c119c3ab671756faba669a91950b7: Status 404 returned error can't find the container with id 86727dca462e314342c02abaf77804cc208c119c3ab671756faba669a91950b7
Sep 11 21:05:34.141530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.141424    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dmszh"
Sep 11 21:05:34.143512 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.143495    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7434344_3ab9_4250_9f03_d548af3bb9a4.slice/crio-8443becd38f5a2f469420db112542716bf680ae9ed03e662d4639c662d2a6ca2 WatchSource:0}: Error finding container 8443becd38f5a2f469420db112542716bf680ae9ed03e662d4639c662d2a6ca2: Status 404 returned error can't find the container with id 8443becd38f5a2f469420db112542716bf680ae9ed03e662d4639c662d2a6ca2
Sep 11 21:05:34.147622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.147605    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cc287"
Sep 11 21:05:34.149459 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.149440    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1c9348_76bf_4b45_90a0_35d9aa36cfe7.slice/crio-076719c7aeb8559b821a7082b5494be1530cc081a47af2c05bbc1635ad1d02ae WatchSource:0}: Error finding container 076719c7aeb8559b821a7082b5494be1530cc081a47af2c05bbc1635ad1d02ae: Status 404 returned error can't find the container with id 076719c7aeb8559b821a7082b5494be1530cc081a47af2c05bbc1635ad1d02ae
Sep 11 21:05:34.152376 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.152359    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:34.156043 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.156028    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda137b21b_063b_4b9a_8b87_7a5e550cb98e.slice/crio-abeb77f9a3439dcf8df581e2c5331f7ecbea7b5e48f4f45333ab0c7ddfb7865c WatchSource:0}: Error finding container abeb77f9a3439dcf8df581e2c5331f7ecbea7b5e48f4f45333ab0c7ddfb7865c: Status 404 returned error can't find the container with id abeb77f9a3439dcf8df581e2c5331f7ecbea7b5e48f4f45333ab0c7ddfb7865c
Sep 11 21:05:34.157052 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.157037    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2wsdz"
Sep 11 21:05:34.161352 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.161330    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658ea950_2c87_4b61_94f3_cd9dd8725957.slice/crio-c9b023fb7e5e16be8b20b4460fe4806cd4e51035e4bd769d99bc10da34832813 WatchSource:0}: Error finding container c9b023fb7e5e16be8b20b4460fe4806cd4e51035e4bd769d99bc10da34832813: Status 404 returned error can't find the container with id c9b023fb7e5e16be8b20b4460fe4806cd4e51035e4bd769d99bc10da34832813
Sep 11 21:05:34.165548 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:05:34.165530    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf736d5_b745_40a7_87c8_c717499d60ab.slice/crio-7a8893c2c52ab43c127f7608a5692c821057fcb526ca81d9be529d036413a133 WatchSource:0}: Error finding container 7a8893c2c52ab43c127f7608a5692c821057fcb526ca81d9be529d036413a133: Status 404 returned error can't find the container with id 7a8893c2c52ab43c127f7608a5692c821057fcb526ca81d9be529d036413a133
Sep 11 21:05:34.435914 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.435842    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:34.436069 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.436024    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:34.436132 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.436100    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:05:35.436080716 +0000 UTC m=+4.027594033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:34.536899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.536208    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:34.536899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.536271    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.536899 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.536389    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:34.536899 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.536448    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:35.536429655 +0000 UTC m=+4.127942973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:34.536899 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.536878    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:34.536899 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.536904    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:34.537323 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.536917    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:34.537323 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.536969    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:35.536954231 +0000 UTC m=+4.128467545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:34.866024 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.865919    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:00:33 +0000 UTC" deadline="2028-05-21 18:07:20.615011122 +0000 UTC"
Sep 11 21:05:34.866024 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.865959    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14829h1m45.749055958s"
Sep 11 21:05:34.880355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.880328    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:34.880487 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.880456    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:34.880890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.880874    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:34.880981 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:34.880967    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:34.898501 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.898473    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wsdz" event={"ID":"bcf736d5-b745-40a7-87c8-c717499d60ab","Type":"ContainerStarted","Data":"7a8893c2c52ab43c127f7608a5692c821057fcb526ca81d9be529d036413a133"}
Sep 11 21:05:34.906027 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.905977    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75tz9" event={"ID":"658ea950-2c87-4b61-94f3-cd9dd8725957","Type":"ContainerStarted","Data":"c9b023fb7e5e16be8b20b4460fe4806cd4e51035e4bd769d99bc10da34832813"}
Sep 11 21:05:34.916129 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.916068    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dmszh" event={"ID":"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7","Type":"ContainerStarted","Data":"076719c7aeb8559b821a7082b5494be1530cc081a47af2c05bbc1635ad1d02ae"}
Sep 11 21:05:34.921051 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.921027    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"8443becd38f5a2f469420db112542716bf680ae9ed03e662d4639c662d2a6ca2"}
Sep 11 21:05:34.923331 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.923307    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t" event={"ID":"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33","Type":"ContainerStarted","Data":"dc7a0be100d73b1111d09012d425ce4fdd41615bc2f3042c90d9e035e38d7449"}
Sep 11 21:05:34.930256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.930227    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cc287" event={"ID":"a137b21b-063b-4b9a-8b87-7a5e550cb98e","Type":"ContainerStarted","Data":"abeb77f9a3439dcf8df581e2c5331f7ecbea7b5e48f4f45333ab0c7ddfb7865c"}
Sep 11 21:05:34.932492 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.932470    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerStarted","Data":"86727dca462e314342c02abaf77804cc208c119c3ab671756faba669a91950b7"}
Sep 11 21:05:34.935201 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.935148    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdx6l" event={"ID":"79192859-1f89-4395-b14a-e52bee7a6950","Type":"ContainerStarted","Data":"5e37120e86455f992e5ed81f8e2aca5e95898dcf00207c211fa5bd779c2d9463"}
Sep 11 21:05:34.937802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:34.937772    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vhn7v" event={"ID":"63642ec5-6d06-4d2b-aff5-51465eade3a6","Type":"ContainerStarted","Data":"bf7b070c759efd812ec191386af0973eb674a20c5d957d40e6609004e8929663"}
Sep 11 21:05:35.445122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:35.445088    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:35.445312 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.445248    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:35.445378 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.445312    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:05:37.445292979 +0000 UTC m=+6.036806287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:35.545705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:35.545651    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:35.545705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:35.545713    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:35.545991 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.545861    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:35.545991 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.545922    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:37.54590356 +0000 UTC m=+6.137416873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:35.546328 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.546308    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:35.546408 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.546332    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:35.546408 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.546344    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:35.546408 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.546388    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:37.54637495 +0000 UTC m=+6.137888252 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:35.866539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:35.866451    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:00:33 +0000 UTC" deadline="2028-04-23 16:33:09.186897873 +0000 UTC"
Sep 11 21:05:35.866539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:35.866491    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14155h27m33.320411273s"
Sep 11 21:05:35.886901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:35.884016    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:35.886901 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:35.884234    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:36.880465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:36.880389    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:36.880942 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:36.880518    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:36.880942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:36.880591    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:36.880942 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:36.880677    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:37.462402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:37.462366    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:37.462593 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.462519    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:37.462593 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.462585    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:05:41.462566077 +0000 UTC m=+10.054079403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:37.563226 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:37.563191    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:37.563394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:37.563255    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:37.563394 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.563374    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:37.563526 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.563432    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:41.563414049 +0000 UTC m=+10.154927354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:37.564121 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.563847    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:37.564121 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.563870    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:37.564121 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.563882    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:37.564121 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.563929    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:41.563912842 +0000 UTC m=+10.155426150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:37.880430 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:37.880362    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:37.880576 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:37.880505    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:38.880210 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:38.880179    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:38.880413 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:38.880361    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:38.880750 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:38.880732    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:38.881115 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:38.880824    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:39.883200 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:39.882722    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:39.883200 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:39.882854    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:40.880048 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:40.880015    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:40.880228 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:40.880146    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:40.880672 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:40.880598    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:40.880790 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:40.880732    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:41.494490 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:41.494450    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:41.494982 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.494602    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:41.494982 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.494678    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:05:49.494658747 +0000 UTC m=+18.086172052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:41.594949 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:41.594895    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:41.595114 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.595023    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:41.595114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:41.595068    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:41.595114 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.595091    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:49.595071451 +0000 UTC m=+18.186584767 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:41.595299 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.595180    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:41.595299 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.595203    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:41.595299 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.595217    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:41.595299 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.595282    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:05:49.595265314 +0000 UTC m=+18.186778632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:41.881850 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:41.881068    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:41.881850 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:41.881192    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:42.880760 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:42.880115    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:42.880760 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:42.880246    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:42.880760 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:42.880617    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:42.880760 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:42.880722    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:43.880196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:43.880166    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:43.880377 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:43.880299    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:44.880358 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:44.880321    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:44.880740 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:44.880321    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:44.880740 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:44.880429    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:44.880740 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:44.880490    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:45.880139 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:45.880107    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:45.880325 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:45.880220    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:46.880308 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:46.880275    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:46.880841 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:46.880398    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:46.880841 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:46.880462    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:46.880841 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:46.880571    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:47.880613 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:47.880576    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:47.881065 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:47.880704    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:48.880831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:48.880796    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:48.881246 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:48.880911    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:48.881246 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:48.880962    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:48.881246 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:48.881061    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:49.550903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:49.550866    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:49.551172 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.551042    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:49.551172 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.551119    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:06:05.551094634 +0000 UTC m=+34.142607945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:05:49.651740 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:49.651696    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:49.651929 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:49.651761    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:49.651929 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.651868    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:49.651929 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.651890    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:05:49.651929 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.651915    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:05:49.651929 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.651923    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:05.651909648 +0000 UTC m=+34.243422949 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:05:49.651929 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.651925    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:49.652215 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.651970    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:05.651961526 +0000 UTC m=+34.243474828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:05:49.880729 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:49.880650    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:49.880878 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:49.880790    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:50.879889 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:50.879860    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:50.880075 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:50.879859    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:50.880075 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:50.879963    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:50.880075 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:50.880048    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:51.880670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:51.880625    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:51.881108 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:51.880731    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:52.880940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:52.880797    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:52.881238 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:52.880866    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:52.881238 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:52.881054    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:52.881238 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:52.881081    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:52.976372 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:52.976338    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal" event={"ID":"6abc4d8c8ce3d693c97b0f59444f7f92","Type":"ContainerStarted","Data":"a149ea4015a88393a02fd1f20dc91ca02b6b61fae5c2b593e5e507e06db6d7e2"}
Sep 11 21:05:52.978034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:52.978011    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"2b26e8f1806ca92741cec75cdeedf009325a0c147f4370e17e341901191a5316"}
Sep 11 21:05:52.979447 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:52.979429    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vhn7v" event={"ID":"63642ec5-6d06-4d2b-aff5-51465eade3a6","Type":"ContainerStarted","Data":"c8488266f4aa22a04702216d1a3b26928bdd86f0bc13952b7e365b9b708e3a7e"}
Sep 11 21:05:53.018859 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.018810    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-37.ec2.internal" podStartSLOduration=20.018796683 podStartE2EDuration="20.018796683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:52.998493507 +0000 UTC m=+21.590006831" watchObservedRunningTime="2026-09-11 21:05:53.018796683 +0000 UTC m=+21.610310059"
Sep 11 21:05:53.019125 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.019100    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vhn7v" podStartSLOduration=2.460409957 podStartE2EDuration="21.019093467s" totalImagesPullingTime="18.55868351s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:53.018555493 +0000 UTC m=+21.610068817" watchObservedRunningTime="2026-09-11 21:05:53.019093467 +0000 UTC m=+21.610606793"
Sep 11 21:05:53.880688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.880501    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:53.880840 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:53.880801    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:53.985853 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.985780    2585 generic.go:356] "Generic (PLEG): container finished" podID="5723e815bf040e5d45b5f45f3fe46312" containerID="17b65b227848be6a9ec175cf66b43ca927762110d65d654d19cfe6bc852db3d7" exitCode=0
Sep 11 21:05:53.986467 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.985867    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal" event={"ID":"5723e815bf040e5d45b5f45f3fe46312","Type":"ContainerDied","Data":"17b65b227848be6a9ec175cf66b43ca927762110d65d654d19cfe6bc852db3d7"}
Sep 11 21:05:53.987506 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.987477    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2wsdz" event={"ID":"bcf736d5-b745-40a7-87c8-c717499d60ab","Type":"ContainerStarted","Data":"5a19660902a8df245e1bd08d9d6061a0835a31e12dc49b903be1b583a998096a"}
Sep 11 21:05:53.988982 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.988960    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-75tz9" event={"ID":"658ea950-2c87-4b61-94f3-cd9dd8725957","Type":"ContainerStarted","Data":"557ccbe6b8807ee92a67fc22835b9c892e7d03f443b8cd210badfb0bf13c84ee"}
Sep 11 21:05:53.990406 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.990386    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dmszh" event={"ID":"ae1c9348-76bf-4b45-90a0-35d9aa36cfe7","Type":"ContainerStarted","Data":"016d6cdc35ed5f2ff34723fd9be016d106b173d112af4985bdf83f7e2d6c5dec"}
Sep 11 21:05:53.993022 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993008    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:05:53.993345 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993325    2585 generic.go:356] "Generic (PLEG): container finished" podID="d7434344-3ab9-4250-9f03-d548af3bb9a4" containerID="472fdf1fc1c437a554bf1b9145af3951b978024abdc224a4a4cce59b0822d77b" exitCode=1
Sep 11 21:05:53.993422 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993389    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"3e6039160e69919444e04ed295983d2526f1a957aab6995683517223c2207345"}
Sep 11 21:05:53.993468 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993441    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"c1c47e327d5abe2541eee48922809ad495c00de343aaf0ae3bca8df85f4d3ee4"}
Sep 11 21:05:53.993516 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993474    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"796ef2c5668b4334e6ed3cc305082d6767b83b3a1b0d9d2675ffd9d797e39eaa"}
Sep 11 21:05:53.993516 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993512    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"01a750fb39f0ecb9b6efd60d75344a8965e16cdb8058418f63b0a04ca8f86cfc"}
Sep 11 21:05:53.993579 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.993543    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerDied","Data":"472fdf1fc1c437a554bf1b9145af3951b978024abdc224a4a4cce59b0822d77b"}
Sep 11 21:05:53.994968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.994946    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t" event={"ID":"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33","Type":"ContainerStarted","Data":"0ec0744e8247883f2b98f1faa5e34d3477869a2032cfa5cb670a979c4079af29"}
Sep 11 21:05:53.996465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.996442    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cc287" event={"ID":"a137b21b-063b-4b9a-8b87-7a5e550cb98e","Type":"ContainerStarted","Data":"d42d78897d587e3416fa4c1d964400fa92d5f669549bd25fdcf92ef04adaceb5"}
Sep 11 21:05:53.998055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.998038    2585 generic.go:356] "Generic (PLEG): container finished" podID="001078c7-c95f-4cb5-922c-d4ee0f1beecf" containerID="5098a380c9ab503ab76737857dddfe27b3cc3006f3ad6aa4be3ffc777b99c8b7" exitCode=0
Sep 11 21:05:53.998136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.998096    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerDied","Data":"5098a380c9ab503ab76737857dddfe27b3cc3006f3ad6aa4be3ffc777b99c8b7"}
Sep 11 21:05:53.999665 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:53.999620    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tdx6l" event={"ID":"79192859-1f89-4395-b14a-e52bee7a6950","Type":"ContainerStarted","Data":"ac8280ef30cea4729f5f90b08825209065a344c7bb91216e12c7ecaaed9b1e71"}
Sep 11 21:05:54.030913 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.030866    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2wsdz" podStartSLOduration=3.8139532000000003 podStartE2EDuration="22.030849017s" totalImagesPullingTime="18.216895817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:54.017154251 +0000 UTC m=+22.608667576" watchObservedRunningTime="2026-09-11 21:05:54.030849017 +0000 UTC m=+22.622362339"
Sep 11 21:05:54.047336 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.047287    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-75tz9" podStartSLOduration=3.5448827290000002 podStartE2EDuration="22.047271709s" totalImagesPullingTime="18.50238898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:54.047236482 +0000 UTC m=+22.638749805" watchObservedRunningTime="2026-09-11 21:05:54.047271709 +0000 UTC m=+22.638785032"
Sep 11 21:05:54.047489 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.047461    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dmszh" podStartSLOduration=3.814704614 podStartE2EDuration="22.047454421s" totalImagesPullingTime="18.232749807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:54.030510177 +0000 UTC m=+22.622023502" watchObservedRunningTime="2026-09-11 21:05:54.047454421 +0000 UTC m=+22.638967764"
Sep 11 21:05:54.089364 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.089323    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tdx6l" podStartSLOduration=3.538925753 podStartE2EDuration="22.08931075s" totalImagesPullingTime="18.550384997s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:54.063215226 +0000 UTC m=+22.654728550" watchObservedRunningTime="2026-09-11 21:05:54.08931075 +0000 UTC m=+22.680824136"
Sep 11 21:05:54.112449 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.112409    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cc287" podStartSLOduration=3.010039295 podStartE2EDuration="22.112396256s" totalImagesPullingTime="19.102356961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:54.112279155 +0000 UTC m=+22.703792478" watchObservedRunningTime="2026-09-11 21:05:54.112396256 +0000 UTC m=+22.703909578"
Sep 11 21:05:54.288038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.288015    2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 21:05:54.782883 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.782845    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:54.783479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.783459    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:54.880762 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.880730    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:54.880928 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:54.880730    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:54.880928 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:54.880858    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:54.881048 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:54.880977    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:55.004717 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.004677    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal" event={"ID":"5723e815bf040e5d45b5f45f3fe46312","Type":"ContainerStarted","Data":"0f66d0e8024c404b53477eb382a93e59673efe53bb2cd06bbd881d76cc10f307"}
Sep 11 21:05:55.007186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.007110    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t" event={"ID":"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33","Type":"ContainerStarted","Data":"57b32db1ef4667d6e24a0a38da6fef228992d685c541801014c38557b4e4488b"}
Sep 11 21:05:55.008371 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.008342    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:55.008833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.008794    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-75tz9"
Sep 11 21:05:55.021163 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.021116    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-37.ec2.internal" podStartSLOduration=22.021101586 podStartE2EDuration="22.021101586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:55.020630436 +0000 UTC m=+23.612143785" watchObservedRunningTime="2026-09-11 21:05:55.021101586 +0000 UTC m=+23.612614927"
Sep 11 21:05:55.026848 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.026772    2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T21:05:54.28803257Z","UUID":"fee560ea-242c-4e7a-9a70-9e32fb4c83f9","Handler":null,"Name":"","Endpoint":""}
Sep 11 21:05:55.028280 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.028264    2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 21:05:55.028374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.028294    2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 21:05:55.880230 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:55.880193    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:55.880420 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:55.880316    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:56.013334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:56.013306    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:05:56.013799 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:56.013774    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"76021f45a4f2ce0e129139499d4807a2587c527ec3f9690c15fff93b00f63884"}
Sep 11 21:05:56.016455 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:56.016421    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t" event={"ID":"c859a7ff-bb48-4de5-87d4-daa5cf3f9b33","Type":"ContainerStarted","Data":"916643e2b608d51e6169a6b33200e1cd8e4a8224dfd443c1899a87fd94514d1d"}
Sep 11 21:05:56.037085 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:56.037034    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hhc5t" podStartSLOduration=3.979444216 podStartE2EDuration="24.037014981s" totalImagesPullingTime="20.057570765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:05:56.036252951 +0000 UTC m=+24.627766275" watchObservedRunningTime="2026-09-11 21:05:56.037014981 +0000 UTC m=+24.628528305"
Sep 11 21:05:56.880797 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:56.880766    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:56.880797 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:56.880792    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:56.880992 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:56.880874    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:56.881034 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:56.880999    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:57.880709 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:57.880672    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:57.881125 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:57.880818    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:05:58.880014 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:58.879860    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:05:58.880149 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:58.879860    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:05:58.880149 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:58.880087    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:05:58.880235 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:58.880148    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:05:59.026461 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.026433    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:05:59.026885 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.026827    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"d79cccaccf6a85ac5f11a59c1cce369a8a500abca9918d6efb9ce694e2523959"}
Sep 11 21:05:59.027109 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.027086    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:59.027252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.027154    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:59.027252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.027202    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:59.027252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.027228    2585 scope.go:117] "RemoveContainer" containerID="472fdf1fc1c437a554bf1b9145af3951b978024abdc224a4a4cce59b0822d77b"
Sep 11 21:05:59.028953 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.028924    2585 generic.go:356] "Generic (PLEG): container finished" podID="001078c7-c95f-4cb5-922c-d4ee0f1beecf" containerID="7a7e975755c53c67d1427d5b344627330b5fbabeee00eaaace1c8b86c12169a9" exitCode=0
Sep 11 21:05:59.029040 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.028969    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerDied","Data":"7a7e975755c53c67d1427d5b344627330b5fbabeee00eaaace1c8b86c12169a9"}
Sep 11 21:05:59.042605 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.042586    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:59.043347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.043325    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:05:59.880783 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:05:59.880752    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:05:59.880929 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:05:59.880897    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:06:00.036467 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.036417    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:06:00.036914 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.036818    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" event={"ID":"d7434344-3ab9-4250-9f03-d548af3bb9a4","Type":"ContainerStarted","Data":"766aa8e4423e93c035e43d1b19fd79d0e3cd709f4d4190a94dfdc1bfb024b2c0"}
Sep 11 21:06:00.206607 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.206557    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv" podStartSLOduration=9.633292724 podStartE2EDuration="28.206538919s" totalImagesPullingTime="18.573246195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:00.098770097 +0000 UTC m=+28.690283419" watchObservedRunningTime="2026-09-11 21:06:00.206538919 +0000 UTC m=+28.798052280"
Sep 11 21:06:00.207149 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.207127    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7w4fr"]
Sep 11 21:06:00.207278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.207266    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:00.207379 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:00.207363    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:06:00.210134 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.210109    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm2zj"]
Sep 11 21:06:00.210249 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.210222    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:00.210323 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:00.210306    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:06:00.212707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.212687    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dz4bj"]
Sep 11 21:06:00.212805 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:00.212770    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:00.212859 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:00.212843    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:06:01.041715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:01.041684    2585 generic.go:356] "Generic (PLEG): container finished" podID="001078c7-c95f-4cb5-922c-d4ee0f1beecf" containerID="d06b6722ed7e93cee7fc75f406068e0e6cf1f24a9250c6c4fc95083e31360d06" exitCode=0
Sep 11 21:06:01.042166 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:01.041763    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerDied","Data":"d06b6722ed7e93cee7fc75f406068e0e6cf1f24a9250c6c4fc95083e31360d06"}
Sep 11 21:06:01.881578 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:01.881500    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:01.881749 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:01.881605    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:06:01.881749 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:01.881692    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:01.881858 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:01.881803    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:06:01.881858 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:01.881855    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:01.881969 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:01.881946    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:06:02.045707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:02.045677    2585 generic.go:356] "Generic (PLEG): container finished" podID="001078c7-c95f-4cb5-922c-d4ee0f1beecf" containerID="26dc5f444b1281d2f23dda8300ddde0a07041aa49f98a787906ef4df047e8606" exitCode=0
Sep 11 21:06:02.046045 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:02.045746    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerDied","Data":"26dc5f444b1281d2f23dda8300ddde0a07041aa49f98a787906ef4df047e8606"}
Sep 11 21:06:03.881014 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:03.880982    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:03.881432 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:03.880989    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:03.881432 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:03.881109    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:06:03.881432 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:03.881179    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:06:03.881432 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:03.880989    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:03.881432 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:03.881303    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:06:05.566850 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:05.566820    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:05.567189 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.566921    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:05.567189 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.566970    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs podName:1a457fc6-a504-442e-9933-c616c05738ad nodeName:}" failed. No retries permitted until 2026-09-11 21:06:37.566956622 +0000 UTC m=+66.158469936 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs") pod "network-metrics-daemon-rm2zj" (UID: "1a457fc6-a504-442e-9933-c616c05738ad") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:06:05.668027 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:05.668000    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:05.668196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:05.668053    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:05.668196 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.668177    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:06:05.668311 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.668199    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:05.668311 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.668206    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:06:05.668311 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.668225    2585 projected.go:196] Error preparing data for projected volume kube-api-access-6zs8l for pod openshift-network-diagnostics/network-check-target-7w4fr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:05.668311 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.668273    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret podName:1de3c338-5441-4be4-a5b9-10645947fc29 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:37.668251795 +0000 UTC m=+66.259765111 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret") pod "global-pull-secret-syncer-dz4bj" (UID: "1de3c338-5441-4be4-a5b9-10645947fc29") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:06:05.668311 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.668292    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l podName:65adf28c-82be-49ac-b6a9-bb567956efc5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:37.668284565 +0000 UTC m=+66.259797871 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6zs8l" (UniqueName: "kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l") pod "network-check-target-7w4fr" (UID: "65adf28c-82be-49ac-b6a9-bb567956efc5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:06:05.880670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:05.880525    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:05.880670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:05.880562    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:05.880670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:05.880572    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:05.880930 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.880665    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dz4bj" podUID="1de3c338-5441-4be4-a5b9-10645947fc29"
Sep 11 21:06:05.880930 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.880805    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7w4fr" podUID="65adf28c-82be-49ac-b6a9-bb567956efc5"
Sep 11 21:06:05.880930 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:05.880897    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rm2zj" podUID="1a457fc6-a504-442e-9933-c616c05738ad"
Sep 11 21:06:06.198139 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.198057    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-37.ec2.internal" event="NodeReady"
Sep 11 21:06:06.198310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.198198    2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 21:06:06.238465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.238434    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"]
Sep 11 21:06:06.266898 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.266868    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"]
Sep 11 21:06:06.266898 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.266908    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gzrnn"]
Sep 11 21:06:06.267137 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.267009    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.270865 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.270844    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 21:06:06.271273 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.271257    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 21:06:06.271273 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.271263    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 21:06:06.271563 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.271544    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j64xm\""
Sep 11 21:06:06.276815 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.276794    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 21:06:06.281192 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.281159    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qgv57"]
Sep 11 21:06:06.281293 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.281278    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.284401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.284383    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rvmq7\""
Sep 11 21:06:06.284496 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.284478    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 21:06:06.285296 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.284952    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 21:06:06.286056 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.285859    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 21:06:06.297337 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.297319    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzrnn"]
Sep 11 21:06:06.297419 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.297351    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgv57"]
Sep 11 21:06:06.297486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.297439    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.299858 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.299800    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f5khd\""
Sep 11 21:06:06.299969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.299898    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 21:06:06.299969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.299911    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 21:06:06.374754 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374727    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-installation-pull-secrets\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.374918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374766    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb07137d-3e54-4088-a37a-3cf63fc4ab60-cert\") pod \"ingress-canary-gzrnn\" (UID: \"eb07137d-3e54-4088-a37a-3cf63fc4ab60\") " pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.374918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374791    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-trusted-ca\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.374918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374847    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m27c\" (UniqueName: \"kubernetes.io/projected/eb07137d-3e54-4088-a37a-3cf63fc4ab60-kube-api-access-6m27c\") pod \"ingress-canary-gzrnn\" (UID: \"eb07137d-3e54-4088-a37a-3cf63fc4ab60\") " pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.374918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374887    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m829n\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-kube-api-access-m829n\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.374918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374913    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6164295-ad3b-4b87-a92a-00a79fb58bcc-tmp-dir\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.375136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374977    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-image-registry-private-configuration\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.375136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.374997    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-certificates\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.375136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.375023    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6164295-ad3b-4b87-a92a-00a79fb58bcc-config-volume\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.375136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.375058    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9db7cf20-a90e-4880-815d-f9b629f77af5-ca-trust-extracted\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.375136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.375098    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt427\" (UniqueName: \"kubernetes.io/projected/d6164295-ad3b-4b87-a92a-00a79fb58bcc-kube-api-access-vt427\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.375369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.375167    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.375369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.375201    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.375369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.375244    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-bound-sa-token\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.475890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.475814    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6164295-ad3b-4b87-a92a-00a79fb58bcc-config-volume\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.475890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.475862    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9db7cf20-a90e-4880-815d-f9b629f77af5-ca-trust-extracted\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.475893    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt427\" (UniqueName: \"kubernetes.io/projected/d6164295-ad3b-4b87-a92a-00a79fb58bcc-kube-api-access-vt427\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.476097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.475927    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.475950    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.476097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.475981    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-bound-sa-token\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-installation-pull-secrets\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476072    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb07137d-3e54-4088-a37a-3cf63fc4ab60-cert\") pod \"ingress-canary-gzrnn\" (UID: \"eb07137d-3e54-4088-a37a-3cf63fc4ab60\") " pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476108    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-trusted-ca\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476136    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m27c\" (UniqueName: \"kubernetes.io/projected/eb07137d-3e54-4088-a37a-3cf63fc4ab60-kube-api-access-6m27c\") pod \"ingress-canary-gzrnn\" (UID: \"eb07137d-3e54-4088-a37a-3cf63fc4ab60\") " pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476160    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m829n\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-kube-api-access-m829n\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476181    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6164295-ad3b-4b87-a92a-00a79fb58bcc-tmp-dir\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.476041    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.476230    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd: secret "image-registry-tls" not found
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-image-registry-private-configuration\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476269    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-certificates\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.476292    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls podName:9db7cf20-a90e-4880-815d-f9b629f77af5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:06.976273794 +0000 UTC m=+35.567787160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls") pod "image-registry-7d7ff4f9fc-tnzxd" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5") : secret "image-registry-tls" not found
Sep 11 21:06:06.476350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476293    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9db7cf20-a90e-4880-815d-f9b629f77af5-ca-trust-extracted\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476448    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6164295-ad3b-4b87-a92a-00a79fb58bcc-config-volume\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.476679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476552    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6164295-ad3b-4b87-a92a-00a79fb58bcc-tmp-dir\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.476755 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.476106    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:06:06.476811 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.476789    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-certificates\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.476946 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.476888    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls podName:d6164295-ad3b-4b87-a92a-00a79fb58bcc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:06.97686497 +0000 UTC m=+35.568378275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls") pod "dns-default-qgv57" (UID: "d6164295-ad3b-4b87-a92a-00a79fb58bcc") : secret "dns-default-metrics-tls" not found
Sep 11 21:06:06.477438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.477385    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-trusted-ca\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.480791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.480720    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-image-registry-private-configuration\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.480791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.480746    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb07137d-3e54-4088-a37a-3cf63fc4ab60-cert\") pod \"ingress-canary-gzrnn\" (UID: \"eb07137d-3e54-4088-a37a-3cf63fc4ab60\") " pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.480791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.480722    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-installation-pull-secrets\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.495109 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.495090    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m27c\" (UniqueName: \"kubernetes.io/projected/eb07137d-3e54-4088-a37a-3cf63fc4ab60-kube-api-access-6m27c\") pod \"ingress-canary-gzrnn\" (UID: \"eb07137d-3e54-4088-a37a-3cf63fc4ab60\") " pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.495203 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.495166    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-bound-sa-token\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.497811 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.497786    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt427\" (UniqueName: \"kubernetes.io/projected/d6164295-ad3b-4b87-a92a-00a79fb58bcc-kube-api-access-vt427\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.498335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.498316    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m829n\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-kube-api-access-m829n\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.592409 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.592376    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gzrnn"
Sep 11 21:06:06.979401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.979368    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:06.979583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:06.979404    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:06.979583 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.979553    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:06:06.979583 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.979565    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:06:06.979583 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.979575    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd: secret "image-registry-tls" not found
Sep 11 21:06:06.979769 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.979650    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls podName:9db7cf20-a90e-4880-815d-f9b629f77af5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:07.97961744 +0000 UTC m=+36.571130761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls") pod "image-registry-7d7ff4f9fc-tnzxd" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5") : secret "image-registry-tls" not found
Sep 11 21:06:06.979769 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:06.979702    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls podName:d6164295-ad3b-4b87-a92a-00a79fb58bcc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:07.979668726 +0000 UTC m=+36.571182040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls") pod "dns-default-qgv57" (UID: "d6164295-ad3b-4b87-a92a-00a79fb58bcc") : secret "dns-default-metrics-tls" not found
Sep 11 21:06:07.414316 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.414156    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gzrnn"]
Sep 11 21:06:07.464547 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:07.464518    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb07137d_3e54_4088_a37a_3cf63fc4ab60.slice/crio-9e35058ff31610033c66a3f07f9a107cb738b6af29bea41b98403f6d757390b9 WatchSource:0}: Error finding container 9e35058ff31610033c66a3f07f9a107cb738b6af29bea41b98403f6d757390b9: Status 404 returned error can't find the container with id 9e35058ff31610033c66a3f07f9a107cb738b6af29bea41b98403f6d757390b9
Sep 11 21:06:07.880870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.880837    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:07.881212 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.880837    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:07.881212 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.880837    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:07.884359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.884334    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:06:07.884359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.884344    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mpnkz\""
Sep 11 21:06:07.884519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.884383    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwzls\""
Sep 11 21:06:07.884519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.884334    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:06:07.884519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.884337    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:06:07.884519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.884339    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:06:07.988390 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.988337    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:07.988390 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:07.988370    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:07.988540 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:07.988453    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:06:07.988540 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:07.988473    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:06:07.988540 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:07.988487    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd: secret "image-registry-tls" not found
Sep 11 21:06:07.988540 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:07.988495    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls podName:d6164295-ad3b-4b87-a92a-00a79fb58bcc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:09.988483075 +0000 UTC m=+38.579996381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls") pod "dns-default-qgv57" (UID: "d6164295-ad3b-4b87-a92a-00a79fb58bcc") : secret "dns-default-metrics-tls" not found
Sep 11 21:06:07.988540 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:07.988536    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls podName:9db7cf20-a90e-4880-815d-f9b629f77af5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:09.988522137 +0000 UTC m=+38.580035442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls") pod "image-registry-7d7ff4f9fc-tnzxd" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5") : secret "image-registry-tls" not found
Sep 11 21:06:08.062282 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:08.062258    2585 generic.go:356] "Generic (PLEG): container finished" podID="001078c7-c95f-4cb5-922c-d4ee0f1beecf" containerID="ab544fffa910ebce341cd67976645ed29aee787ddc0750f84b5d87064d676719" exitCode=0
Sep 11 21:06:08.062385 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:08.062302    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerDied","Data":"ab544fffa910ebce341cd67976645ed29aee787ddc0750f84b5d87064d676719"}
Sep 11 21:06:08.063446 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:08.063428    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzrnn" event={"ID":"eb07137d-3e54-4088-a37a-3cf63fc4ab60","Type":"ContainerStarted","Data":"9e35058ff31610033c66a3f07f9a107cb738b6af29bea41b98403f6d757390b9"}
Sep 11 21:06:09.070342 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:09.070311    2585 generic.go:356] "Generic (PLEG): container finished" podID="001078c7-c95f-4cb5-922c-d4ee0f1beecf" containerID="32d7053d34597e4aaf3b605ba66f26bc53416e02dcb2c4004998ba4ca2bcd2ba" exitCode=0
Sep 11 21:06:09.070913 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:09.070372    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerDied","Data":"32d7053d34597e4aaf3b605ba66f26bc53416e02dcb2c4004998ba4ca2bcd2ba"}
Sep 11 21:06:10.003524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.003436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:10.003524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.003490    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:10.003763 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:10.003603    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:06:10.003763 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:10.003627    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd: secret "image-registry-tls" not found
Sep 11 21:06:10.003763 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:10.003664    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:06:10.003763 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:10.003713    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls podName:9db7cf20-a90e-4880-815d-f9b629f77af5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:14.003690756 +0000 UTC m=+42.595204062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls") pod "image-registry-7d7ff4f9fc-tnzxd" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5") : secret "image-registry-tls" not found
Sep 11 21:06:10.003763 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:10.003733    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls podName:d6164295-ad3b-4b87-a92a-00a79fb58bcc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:14.003723489 +0000 UTC m=+42.595236793 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls") pod "dns-default-qgv57" (UID: "d6164295-ad3b-4b87-a92a-00a79fb58bcc") : secret "dns-default-metrics-tls" not found
Sep 11 21:06:10.077425 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.077382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" event={"ID":"001078c7-c95f-4cb5-922c-d4ee0f1beecf","Type":"ContainerStarted","Data":"3bc558303ece59e8831f00d101ebb546af401f11298bb478e60066efac415a71"}
Sep 11 21:06:10.107061 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.106965    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pbxxn" podStartSLOduration=7.729511415 podStartE2EDuration="38.106945945s" totalImagesPullingTime="30.37743453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:10.106339717 +0000 UTC m=+38.697853045" watchObservedRunningTime="2026-09-11 21:06:10.106945945 +0000 UTC m=+38.698459268"
Sep 11 21:06:10.344789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.344759    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:10.523236 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.523198    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:10.660577 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:10.660550    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:11.081625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.081582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gzrnn" event={"ID":"eb07137d-3e54-4088-a37a-3cf63fc4ab60","Type":"ContainerStarted","Data":"237530cd1914fcaa08af9c5b9eb6e2f7d7379a91176f914909a2fea1a8041e84"}
Sep 11 21:06:11.101179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.101131    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gzrnn" podStartSLOduration=1.994884233 podStartE2EDuration="5.101113984s" totalImagesPullingTime="3.106229751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:11.099767348 +0000 UTC m=+39.691280667" watchObservedRunningTime="2026-09-11 21:06:11.101113984 +0000 UTC m=+39.692627307"
Sep 11 21:06:11.791941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.791905    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"]
Sep 11 21:06:11.806504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.806472    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"]
Sep 11 21:06:11.806655 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.806591    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:11.809116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.809062    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:06:11.809252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.809120    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 21:06:11.809252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.809235    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 21:06:11.809369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.809245    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 21:06:11.810064 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.810039    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-7srzd\""
Sep 11 21:06:11.914575 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.914549    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c109a323-4cea-41be-82c8-34a7d7f286cb-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:11.914706 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.914596    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c109a323-4cea-41be-82c8-34a7d7f286cb-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:11.914706 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.914616    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjbb9\" (UniqueName: \"kubernetes.io/projected/c109a323-4cea-41be-82c8-34a7d7f286cb-kube-api-access-vjbb9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:11.968965 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.968940    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"]
Sep 11 21:06:11.992161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.992138    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:11.999578 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.997699    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-vmqkc"]
Sep 11 21:06:12.000055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:11.997964    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.000926 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.000800    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 21:06:12.003421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.003402    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.007576 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.007558    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z4479\""
Sep 11 21:06:12.008055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.008042    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 21:06:12.015074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.015052    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjbb9\" (UniqueName: \"kubernetes.io/projected/c109a323-4cea-41be-82c8-34a7d7f286cb-kube-api-access-vjbb9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.015150 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.015137    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c109a323-4cea-41be-82c8-34a7d7f286cb-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.015194 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.015171    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c109a323-4cea-41be-82c8-34a7d7f286cb-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.015727 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.015709    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c109a323-4cea-41be-82c8-34a7d7f286cb-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.018345 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.018325    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c109a323-4cea-41be-82c8-34a7d7f286cb-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.023507 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.023486    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"]
Sep 11 21:06:12.023607 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.023573    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.026147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.026124    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 21:06:12.026265 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.026209    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.026394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.026376    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9q98w\""
Sep 11 21:06:12.026476 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.026459    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 21:06:12.026476 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.026470    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.032287 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.032262    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-vmqkc"]
Sep 11 21:06:12.032840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.032823    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 21:06:12.037155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.037136    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjbb9\" (UniqueName: \"kubernetes.io/projected/c109a323-4cea-41be-82c8-34a7d7f286cb-kube-api-access-vjbb9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-ckjp9\" (UID: \"c109a323-4cea-41be-82c8-34a7d7f286cb\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.067703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.067657    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"]
Sep 11 21:06:12.089947 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.089905    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ftn4h"]
Sep 11 21:06:12.090394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.090379    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"
Sep 11 21:06:12.093574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.093556    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.093698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.093581    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bg9x8\""
Sep 11 21:06:12.093698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.093587    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.103766 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.103749    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"]
Sep 11 21:06:12.103867 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.103851    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.106497 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.106480    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 21:06:12.106561 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.106481    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.106653 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.106620    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 21:06:12.106788 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.106690    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-5l2cl\""
Sep 11 21:06:12.106788 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.106773    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.115506 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115488    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92ee312c-f236-4ed9-a55e-8eea603233ca-config\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.115597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115517    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f22pc\" (UniqueName: \"kubernetes.io/projected/dad7fe4e-7346-4bb7-9bd4-627c051b169b-kube-api-access-f22pc\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.115666 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115579    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkslm\" (UniqueName: \"kubernetes.io/projected/92ee312c-f236-4ed9-a55e-8eea603233ca-kube-api-access-lkslm\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.115936 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115914    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad7fe4e-7346-4bb7-9bd4-627c051b169b-trusted-ca-bundle\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.115986 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115958    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92ee312c-f236-4ed9-a55e-8eea603233ca-serving-cert\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.116035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115960    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 21:06:12.116079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.116025    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"
Sep 11 21:06:12.116079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.115983    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad7fe4e-7346-4bb7-9bd4-627c051b169b-service-ca-bundle\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.116199 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.116184    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dad7fe4e-7346-4bb7-9bd4-627c051b169b-tmp\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.116241 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.116223    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dad7fe4e-7346-4bb7-9bd4-627c051b169b-snapshots\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.116277 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.116245    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dad7fe4e-7346-4bb7-9bd4-627c051b169b-serving-cert\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.121942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.121925    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"]
Sep 11 21:06:12.122046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.122031    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.124038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.124018    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 21:06:12.124243 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.124228    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ttg26\""
Sep 11 21:06:12.124330 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.124276    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.124330 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.124275    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.148083 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.148062    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d9d59f4d8-jpdvl"]
Sep 11 21:06:12.148216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.148198    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.150266 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.150244    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 21:06:12.150409 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.150296    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.150409 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.150350    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.150409 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.150359    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-862vl\""
Sep 11 21:06:12.151563 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.151545    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 21:06:12.170679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170651    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"]
Sep 11 21:06:12.170679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170679    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"]
Sep 11 21:06:12.170823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170692    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"]
Sep 11 21:06:12.170823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170708    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d9d59f4d8-jpdvl"]
Sep 11 21:06:12.170823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170719    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ftn4h"]
Sep 11 21:06:12.170823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170744    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"]
Sep 11 21:06:12.170823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.170754    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.173527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.173508    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 21:06:12.174036 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.174019    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 21:06:12.174784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.174763    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 21:06:12.174901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.174881    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-njr5s\""
Sep 11 21:06:12.175179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.174828    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 21:06:12.175253 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.175203    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 21:06:12.175398 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.175383    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 21:06:12.201810 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.201750    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"]
Sep 11 21:06:12.201918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.201879    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"
Sep 11 21:06:12.204284 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.204263    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lqr4c\""
Sep 11 21:06:12.217490 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217467    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4mn8\" (UniqueName: \"kubernetes.io/projected/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-kube-api-access-d4mn8\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.217578 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217500    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cc689a1-3b4e-45c5-b63a-4415d530e14f-trusted-ca\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.217578 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217520    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc689a1-3b4e-45c5-b63a-4415d530e14f-serving-cert\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.217722 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217703    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw59b\" (UniqueName: \"kubernetes.io/projected/4c261c7a-d759-43f9-956b-753b0a2f61cf-kube-api-access-vw59b\") pod \"volume-data-source-validator-86695b7cc7-4ms9n\" (UID: \"4c261c7a-d759-43f9-956b-753b0a2f61cf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"
Sep 11 21:06:12.217763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217732    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkslm\" (UniqueName: \"kubernetes.io/projected/92ee312c-f236-4ed9-a55e-8eea603233ca-kube-api-access-lkslm\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.217763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217752    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad7fe4e-7346-4bb7-9bd4-627c051b169b-service-ca-bundle\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.217888 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217873    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dad7fe4e-7346-4bb7-9bd4-627c051b169b-tmp\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.217924 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217895    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dad7fe4e-7346-4bb7-9bd4-627c051b169b-snapshots\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.217924 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217915    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dad7fe4e-7346-4bb7-9bd4-627c051b169b-serving-cert\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.218011 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217932    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8q8m\" (UniqueName: \"kubernetes.io/projected/9cc689a1-3b4e-45c5-b63a-4415d530e14f-kube-api-access-t8q8m\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.218011 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.217991    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92ee312c-f236-4ed9-a55e-8eea603233ca-serving-cert\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.218100 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218023    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92ee312c-f236-4ed9-a55e-8eea603233ca-config\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.218100 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218042    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f22pc\" (UniqueName: \"kubernetes.io/projected/dad7fe4e-7346-4bb7-9bd4-627c051b169b-kube-api-access-f22pc\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.218187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218097    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.218187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218129    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cc689a1-3b4e-45c5-b63a-4415d530e14f-config\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.218187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218156    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad7fe4e-7346-4bb7-9bd4-627c051b169b-trusted-ca-bundle\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.218322 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218258    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dad7fe4e-7346-4bb7-9bd4-627c051b169b-tmp\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.218376 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218332    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad7fe4e-7346-4bb7-9bd4-627c051b169b-service-ca-bundle\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.218524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218504    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dad7fe4e-7346-4bb7-9bd4-627c051b169b-snapshots\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.218686 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92ee312c-f236-4ed9-a55e-8eea603233ca-config\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.218970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.218954    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad7fe4e-7346-4bb7-9bd4-627c051b169b-trusted-ca-bundle\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.220219 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.220198    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92ee312c-f236-4ed9-a55e-8eea603233ca-serving-cert\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.220278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.220232    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dad7fe4e-7346-4bb7-9bd4-627c051b169b-serving-cert\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.235656 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.235625    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkslm\" (UniqueName: \"kubernetes.io/projected/92ee312c-f236-4ed9-a55e-8eea603233ca-kube-api-access-lkslm\") pod \"service-ca-operator-cf7c776b7-lmvkz\" (UID: \"92ee312c-f236-4ed9-a55e-8eea603233ca\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.235947 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.235931    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f22pc\" (UniqueName: \"kubernetes.io/projected/dad7fe4e-7346-4bb7-9bd4-627c051b169b-kube-api-access-f22pc\") pod \"insights-operator-5844b856db-vmqkc\" (UID: \"dad7fe4e-7346-4bb7-9bd4-627c051b169b\") " pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.303288 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.303267    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"
Sep 11 21:06:12.318736 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318692    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4mn8\" (UniqueName: \"kubernetes.io/projected/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-kube-api-access-d4mn8\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.318736 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318721    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.318836 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318741    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34-kube-api-access-bx28d\") pod \"network-check-source-6f8b768455-vpwmx\" (UID: \"41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"
Sep 11 21:06:12.318836 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318765    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cc689a1-3b4e-45c5-b63a-4415d530e14f-trusted-ca\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.318901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318877    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc689a1-3b4e-45c5-b63a-4415d530e14f-serving-cert\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.318937 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318921    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zvkg\" (UniqueName: \"kubernetes.io/projected/44c9aacc-e9a0-4505-862e-e202bff49aab-kube-api-access-6zvkg\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.318992 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.318975    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw59b\" (UniqueName: \"kubernetes.io/projected/4c261c7a-d759-43f9-956b-753b0a2f61cf-kube-api-access-vw59b\") pod \"volume-data-source-validator-86695b7cc7-4ms9n\" (UID: \"4c261c7a-d759-43f9-956b-753b0a2f61cf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"
Sep 11 21:06:12.319025 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319001    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgqnn\" (UniqueName: \"kubernetes.io/projected/4154bd61-7946-4587-a37e-a559590bdbd2-kube-api-access-bgqnn\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.319062 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319048    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-stats-auth\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.319101 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8q8m\" (UniqueName: \"kubernetes.io/projected/9cc689a1-3b4e-45c5-b63a-4415d530e14f-kube-api-access-t8q8m\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.319145 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319098    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-default-certificate\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.319311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319280    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.319400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319324    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.319400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319351    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/44c9aacc-e9a0-4505-862e-e202bff49aab-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.319400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319374    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.319400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319395    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cc689a1-3b4e-45c5-b63a-4415d530e14f-config\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.319602 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.319409    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:06:12.319602 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.319467    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls podName:c34ead77-9bae-4bac-8e05-2ef00d0eb9e5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:12.819449113 +0000 UTC m=+41.410962431 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jjbnn" (UID: "c34ead77-9bae-4bac-8e05-2ef00d0eb9e5") : secret "samples-operator-tls" not found
Sep 11 21:06:12.319602 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319553    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9cc689a1-3b4e-45c5-b63a-4415d530e14f-trusted-ca\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.319875 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.319855    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9cc689a1-3b4e-45c5-b63a-4415d530e14f-config\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.320697 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.320681    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9cc689a1-3b4e-45c5-b63a-4415d530e14f-serving-cert\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.327650 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.327620    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8q8m\" (UniqueName: \"kubernetes.io/projected/9cc689a1-3b4e-45c5-b63a-4415d530e14f-kube-api-access-t8q8m\") pod \"console-operator-696884fb9c-ftn4h\" (UID: \"9cc689a1-3b4e-45c5-b63a-4415d530e14f\") " pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.327759 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.327683    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4mn8\" (UniqueName: \"kubernetes.io/projected/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-kube-api-access-d4mn8\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.327759 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.327722    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw59b\" (UniqueName: \"kubernetes.io/projected/4c261c7a-d759-43f9-956b-753b0a2f61cf-kube-api-access-vw59b\") pod \"volume-data-source-validator-86695b7cc7-4ms9n\" (UID: \"4c261c7a-d759-43f9-956b-753b0a2f61cf\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"
Sep 11 21:06:12.333456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.333440    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-vmqkc"
Sep 11 21:06:12.389205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.388331    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:12.400217 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.400191    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"
Sep 11 21:06:12.408598 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.408573    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9"]
Sep 11 21:06:12.411514 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:12.411469    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc109a323_4cea_41be_82c8_34a7d7f286cb.slice/crio-6dc72de702d30e35b606800261a892417997096c995fa6125d277a6c4c99572c WatchSource:0}: Error finding container 6dc72de702d30e35b606800261a892417997096c995fa6125d277a6c4c99572c: Status 404 returned error can't find the container with id 6dc72de702d30e35b606800261a892417997096c995fa6125d277a6c4c99572c
Sep 11 21:06:12.415688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.415578    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:12.419834 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.419812    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zvkg\" (UniqueName: \"kubernetes.io/projected/44c9aacc-e9a0-4505-862e-e202bff49aab-kube-api-access-6zvkg\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.419929 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.419855    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgqnn\" (UniqueName: \"kubernetes.io/projected/4154bd61-7946-4587-a37e-a559590bdbd2-kube-api-access-bgqnn\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.419929 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.419894    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-stats-auth\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.420112 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.420080    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-default-certificate\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.420195 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.420174    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.420313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.420211    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/44c9aacc-e9a0-4505-862e-e202bff49aab-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.420313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.420235    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.420313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.420280    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.420313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.420304    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34-kube-api-access-bx28d\") pod \"network-check-source-6f8b768455-vpwmx\" (UID: \"41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"
Sep 11 21:06:12.420498 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.420324    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:12.920304539 +0000 UTC m=+41.511817859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : configmap references non-existent config key: service-ca.crt
Sep 11 21:06:12.420498 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.420399    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:06:12.420498 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.420462    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:12.920444591 +0000 UTC m=+41.511957908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : secret "router-metrics-certs-default" not found
Sep 11 21:06:12.420498 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.420492    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:12.420674 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.420535    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls podName:44c9aacc-e9a0-4505-862e-e202bff49aab nodeName:}" failed. No retries permitted until 2026-09-11 21:06:12.920521919 +0000 UTC m=+41.512035239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kcrk4" (UID: "44c9aacc-e9a0-4505-862e-e202bff49aab") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:12.421044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.421023    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/44c9aacc-e9a0-4505-862e-e202bff49aab-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.422272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.422254    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-stats-auth\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.422720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.422702    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-default-certificate\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.430581 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.430552    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zvkg\" (UniqueName: \"kubernetes.io/projected/44c9aacc-e9a0-4505-862e-e202bff49aab-kube-api-access-6zvkg\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.430681 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.430597    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx28d\" (UniqueName: \"kubernetes.io/projected/41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34-kube-api-access-bx28d\") pod \"network-check-source-6f8b768455-vpwmx\" (UID: \"41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"
Sep 11 21:06:12.430886 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.430868    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgqnn\" (UniqueName: \"kubernetes.io/projected/4154bd61-7946-4587-a37e-a559590bdbd2-kube-api-access-bgqnn\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.488027 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.487941    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:12.511512 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.511392    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"
Sep 11 21:06:12.605104 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.605082    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz"]
Sep 11 21:06:12.607329 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:12.607292    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92ee312c_f236_4ed9_a55e_8eea603233ca.slice/crio-39ba2148ee0542b696cbd472e664c66258cd2e1910b81b039fc08022da495420 WatchSource:0}: Error finding container 39ba2148ee0542b696cbd472e664c66258cd2e1910b81b039fc08022da495420: Status 404 returned error can't find the container with id 39ba2148ee0542b696cbd472e664c66258cd2e1910b81b039fc08022da495420
Sep 11 21:06:12.609428 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.609403    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-vmqkc"]
Sep 11 21:06:12.612622 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:12.612595    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad7fe4e_7346_4bb7_9bd4_627c051b169b.slice/crio-c4e6d5a72f8dbd0b3b19f07b7c955b8b2b68ca058d2e7571f1a0d939a6e6aa1c WatchSource:0}: Error finding container c4e6d5a72f8dbd0b3b19f07b7c955b8b2b68ca058d2e7571f1a0d939a6e6aa1c: Status 404 returned error can't find the container with id c4e6d5a72f8dbd0b3b19f07b7c955b8b2b68ca058d2e7571f1a0d939a6e6aa1c
Sep 11 21:06:12.689422 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.689403    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n"]
Sep 11 21:06:12.691746 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:12.691723    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c261c7a_d759_43f9_956b_753b0a2f61cf.slice/crio-29b7c22a3c89b5cdd22f9dfe513fdb66ac189f22cbecfa4d5342b5f17b832e85 WatchSource:0}: Error finding container 29b7c22a3c89b5cdd22f9dfe513fdb66ac189f22cbecfa4d5342b5f17b832e85: Status 404 returned error can't find the container with id 29b7c22a3c89b5cdd22f9dfe513fdb66ac189f22cbecfa4d5342b5f17b832e85
Sep 11 21:06:12.737519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.736807    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-ftn4h"]
Sep 11 21:06:12.794842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.794816    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx"]
Sep 11 21:06:12.797289 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:12.797261    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f9d4cd_d48c_4068_8ab2_b8cab1b2ba34.slice/crio-5bddfa10ba70881521984bb47cea777b79ade3c219f482e4ca1e6d76a6080907 WatchSource:0}: Error finding container 5bddfa10ba70881521984bb47cea777b79ade3c219f482e4ca1e6d76a6080907: Status 404 returned error can't find the container with id 5bddfa10ba70881521984bb47cea777b79ade3c219f482e4ca1e6d76a6080907
Sep 11 21:06:12.824539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.824487    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:12.824610 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.824600    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:06:12.824679 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.824665    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls podName:c34ead77-9bae-4bac-8e05-2ef00d0eb9e5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:13.824631412 +0000 UTC m=+42.416144732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jjbnn" (UID: "c34ead77-9bae-4bac-8e05-2ef00d0eb9e5") : secret "samples-operator-tls" not found
Sep 11 21:06:12.925355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.925328    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:12.925471 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.925453    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.925471 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.925464    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:12.925544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:12.925497    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:12.925544 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.925515    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls podName:44c9aacc-e9a0-4505-862e-e202bff49aab nodeName:}" failed. No retries permitted until 2026-09-11 21:06:13.925499764 +0000 UTC m=+42.517013079 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kcrk4" (UID: "44c9aacc-e9a0-4505-862e-e202bff49aab") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:12.925618 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.925557    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:06:12.925618 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.925596    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:13.925581572 +0000 UTC m=+42.517094878 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : configmap references non-existent config key: service-ca.crt
Sep 11 21:06:12.925618 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:12.925618    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:13.925611619 +0000 UTC m=+42.517124919 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : secret "router-metrics-certs-default" not found
Sep 11 21:06:13.087036 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.086986    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx" event={"ID":"41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34","Type":"ContainerStarted","Data":"5bddfa10ba70881521984bb47cea777b79ade3c219f482e4ca1e6d76a6080907"}
Sep 11 21:06:13.088136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.088115    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" event={"ID":"9cc689a1-3b4e-45c5-b63a-4415d530e14f","Type":"ContainerStarted","Data":"b8ead72dc8c40214b30665fd15793e5c7cc72878ec60b3a92f7ffbc3a19ac6d4"}
Sep 11 21:06:13.089165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.089147    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-vmqkc" event={"ID":"dad7fe4e-7346-4bb7-9bd4-627c051b169b","Type":"ContainerStarted","Data":"c4e6d5a72f8dbd0b3b19f07b7c955b8b2b68ca058d2e7571f1a0d939a6e6aa1c"}
Sep 11 21:06:13.090352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.090330    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz" event={"ID":"92ee312c-f236-4ed9-a55e-8eea603233ca","Type":"ContainerStarted","Data":"39ba2148ee0542b696cbd472e664c66258cd2e1910b81b039fc08022da495420"}
Sep 11 21:06:13.091626 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.091606    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9" event={"ID":"c109a323-4cea-41be-82c8-34a7d7f286cb","Type":"ContainerStarted","Data":"6dc72de702d30e35b606800261a892417997096c995fa6125d277a6c4c99572c"}
Sep 11 21:06:13.092566 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.092548    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n" event={"ID":"4c261c7a-d759-43f9-956b-753b0a2f61cf","Type":"ContainerStarted","Data":"29b7c22a3c89b5cdd22f9dfe513fdb66ac189f22cbecfa4d5342b5f17b832e85"}
Sep 11 21:06:13.834157 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.834118    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:13.834401 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.834385    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:06:13.834474 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.834453    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls podName:c34ead77-9bae-4bac-8e05-2ef00d0eb9e5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:15.834434652 +0000 UTC m=+44.425947958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jjbnn" (UID: "c34ead77-9bae-4bac-8e05-2ef00d0eb9e5") : secret "samples-operator-tls" not found
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.935427    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.935494    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:13.935537    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.935683    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.935745    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls podName:44c9aacc-e9a0-4505-862e-e202bff49aab nodeName:}" failed. No retries permitted until 2026-09-11 21:06:15.935726013 +0000 UTC m=+44.527239322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kcrk4" (UID: "44c9aacc-e9a0-4505-862e-e202bff49aab") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.936176    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:15.936146438 +0000 UTC m=+44.527659742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : configmap references non-existent config key: service-ca.crt
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.936248    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:06:13.936333 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:13.936283    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:15.936271805 +0000 UTC m=+44.527785132 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : secret "router-metrics-certs-default" not found
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:14.036285    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:14.036325    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:14.036571    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:14.036623    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls podName:d6164295-ad3b-4b87-a92a-00a79fb58bcc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:22.036607275 +0000 UTC m=+50.628120580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls") pod "dns-default-qgv57" (UID: "d6164295-ad3b-4b87-a92a-00a79fb58bcc") : secret "dns-default-metrics-tls" not found
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:14.036984    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:14.036997    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd: secret "image-registry-tls" not found
Sep 11 21:06:14.037115 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:14.037053    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls podName:9db7cf20-a90e-4880-815d-f9b629f77af5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:22.037026073 +0000 UTC m=+50.628539382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls") pod "image-registry-7d7ff4f9fc-tnzxd" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5") : secret "image-registry-tls" not found
Sep 11 21:06:14.769821 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:14.769784    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:14.870976 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:14.870925    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:15.851622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:15.851589    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:15.852093 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.851737    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:06:15.852093 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.851809    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls podName:c34ead77-9bae-4bac-8e05-2ef00d0eb9e5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:19.851794088 +0000 UTC m=+48.443307394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jjbnn" (UID: "c34ead77-9bae-4bac-8e05-2ef00d0eb9e5") : secret "samples-operator-tls" not found
Sep 11 21:06:15.952319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:15.952286    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:15.952481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:15.952325    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:15.952481 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.952430    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:06:15.952599 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:15.952468    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:15.952599 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.952476    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:19.952458417 +0000 UTC m=+48.543971719 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : secret "router-metrics-certs-default" not found
Sep 11 21:06:15.952599 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.952534    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:19.952513786 +0000 UTC m=+48.544027099 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : configmap references non-existent config key: service-ca.crt
Sep 11 21:06:15.952599 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.952541    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:15.952599 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:15.952573    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls podName:44c9aacc-e9a0-4505-862e-e202bff49aab nodeName:}" failed. No retries permitted until 2026-09-11 21:06:19.952565873 +0000 UTC m=+48.544079173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kcrk4" (UID: "44c9aacc-e9a0-4505-862e-e202bff49aab") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:16.388539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:16.388498    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:16.451806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:16.451766    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:17.451172 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:17.451114    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:17.549499 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:17.549440    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:19.885247 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:19.885185    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:19.885596 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.885370    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:06:19.885596 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.885426    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls podName:c34ead77-9bae-4bac-8e05-2ef00d0eb9e5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.885409724 +0000 UTC m=+56.476923031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jjbnn" (UID: "c34ead77-9bae-4bac-8e05-2ef00d0eb9e5") : secret "samples-operator-tls" not found
Sep 11 21:06:19.986555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:19.986522    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:19.986674 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:19.986576    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:19.986674 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:19.986618    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:19.986778 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.986708    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.986686593 +0000 UTC m=+56.578199899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : configmap references non-existent config key: service-ca.crt
Sep 11 21:06:19.986778 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.986744    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:06:19.986778 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.986752    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:19.986940 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.986796    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.986781751 +0000 UTC m=+56.578295066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : secret "router-metrics-certs-default" not found
Sep 11 21:06:19.986940 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:19.986814    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls podName:44c9aacc-e9a0-4505-862e-e202bff49aab nodeName:}" failed. No retries permitted until 2026-09-11 21:06:27.986804797 +0000 UTC m=+56.578318102 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kcrk4" (UID: "44c9aacc-e9a0-4505-862e-e202bff49aab") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:20.121778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.121751    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n" event={"ID":"4c261c7a-d759-43f9-956b-753b0a2f61cf","Type":"ContainerStarted","Data":"b6fb53933a6e6f8bf3b843acd509724b4fb1c128b45dc21de76c895f35f8e1b8"}
Sep 11 21:06:20.123571 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.123529    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx" event={"ID":"41f9d4cd-d48c-4068-8ab2-b8cab1b2ba34","Type":"ContainerStarted","Data":"a0811ec3d0f277e01ff46f2ecd057a04c0fcc20deec2f6c9442b113301839605"}
Sep 11 21:06:20.125458 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.125439    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/0.log"
Sep 11 21:06:20.125543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.125477    2585 generic.go:356] "Generic (PLEG): container finished" podID="9cc689a1-3b4e-45c5-b63a-4415d530e14f" containerID="f9557cf666deb33b590d3c6bf4d6610ec2adcb91e8b1c7cd20f19848c3416a3b" exitCode=255
Sep 11 21:06:20.125593 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.125548    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" event={"ID":"9cc689a1-3b4e-45c5-b63a-4415d530e14f","Type":"ContainerDied","Data":"f9557cf666deb33b590d3c6bf4d6610ec2adcb91e8b1c7cd20f19848c3416a3b"}
Sep 11 21:06:20.125901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.125864    2585 scope.go:117] "RemoveContainer" containerID="f9557cf666deb33b590d3c6bf4d6610ec2adcb91e8b1c7cd20f19848c3416a3b"
Sep 11 21:06:20.127865 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.127844    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-vmqkc" event={"ID":"dad7fe4e-7346-4bb7-9bd4-627c051b169b","Type":"ContainerStarted","Data":"8d1c23db4033e5af4bfc28923cb6387b3ede0646f4165b9a96256fc1502160bc"}
Sep 11 21:06:20.129907 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.129886    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz" event={"ID":"92ee312c-f236-4ed9-a55e-8eea603233ca","Type":"ContainerStarted","Data":"77e0233d517da61ebc828d4809acadbc2846f3ec9aac46cee50c444da85a440d"}
Sep 11 21:06:20.132174 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.132128    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9" event={"ID":"c109a323-4cea-41be-82c8-34a7d7f286cb","Type":"ContainerStarted","Data":"10bfff349aa5db70cec290bcf73ed566fe213729be00c75802473ae34a040e3f"}
Sep 11 21:06:20.140161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.140107    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-4ms9n" podStartSLOduration=1.6187408859999999 podStartE2EDuration="8.140091899s" totalImagesPullingTime="6.521351013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:20.139660156 +0000 UTC m=+48.731173485" watchObservedRunningTime="2026-09-11 21:06:20.140091899 +0000 UTC m=+48.731605221"
Sep 11 21:06:20.156362 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.156314    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9" podStartSLOduration=2.31528393 podStartE2EDuration="9.156297358s" totalImagesPullingTime="6.841013428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:20.154959585 +0000 UTC m=+48.746472906" watchObservedRunningTime="2026-09-11 21:06:20.156297358 +0000 UTC m=+48.747810686"
Sep 11 21:06:20.178452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.178302    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-vmqkc" podStartSLOduration=2.537533288 podStartE2EDuration="9.178285632s" totalImagesPullingTime="6.640752344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:20.177492402 +0000 UTC m=+48.769005726" watchObservedRunningTime="2026-09-11 21:06:20.178285632 +0000 UTC m=+48.769798951"
Sep 11 21:06:20.219657 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.219563    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-vpwmx" podStartSLOduration=1.422142033 podStartE2EDuration="8.219545535s" totalImagesPullingTime="6.797403502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:20.199156961 +0000 UTC m=+48.790670285" watchObservedRunningTime="2026-09-11 21:06:20.219545535 +0000 UTC m=+48.811058863"
Sep 11 21:06:20.220187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.220149    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz" podStartSLOduration=2.568930263 podStartE2EDuration="9.220134273s" totalImagesPullingTime="6.65120401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:20.218997956 +0000 UTC m=+48.810511280" watchObservedRunningTime="2026-09-11 21:06:20.220134273 +0000 UTC m=+48.811647611"
Sep 11 21:06:20.247450 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.247423    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:20.342009 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.341983    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:20.585279 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.585247    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:20.676706 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.676676    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:20.776313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:20.776285    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:21.082306 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.082268    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8cq74"]
Sep 11 21:06:21.099304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.099263    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:21.103564 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.103532    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cq74"]
Sep 11 21:06:21.103727 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.103674    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.105989 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.105963    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 21:06:21.106138 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.106095    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 21:06:21.106286 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.106231    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gq824\""
Sep 11 21:06:21.137738 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.137707    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:06:21.138238 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.138219    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/0.log"
Sep 11 21:06:21.138302 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.138262    2585 generic.go:356] "Generic (PLEG): container finished" podID="9cc689a1-3b4e-45c5-b63a-4415d530e14f" containerID="cc1d4c88ee52f5f442759409eabca1f33f03b90fbfcdbeaf9525414963a7005d" exitCode=255
Sep 11 21:06:21.138375 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.138348    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" event={"ID":"9cc689a1-3b4e-45c5-b63a-4415d530e14f","Type":"ContainerDied","Data":"cc1d4c88ee52f5f442759409eabca1f33f03b90fbfcdbeaf9525414963a7005d"}
Sep 11 21:06:21.138441 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.138414    2585 scope.go:117] "RemoveContainer" containerID="f9557cf666deb33b590d3c6bf4d6610ec2adcb91e8b1c7cd20f19848c3416a3b"
Sep 11 21:06:21.138585 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.138567    2585 scope.go:117] "RemoveContainer" containerID="cc1d4c88ee52f5f442759409eabca1f33f03b90fbfcdbeaf9525414963a7005d"
Sep 11 21:06:21.138896 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.138871    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ftn4h_openshift-console-operator(9cc689a1-3b4e-45c5-b63a-4415d530e14f)\"" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" podUID="9cc689a1-3b4e-45c5-b63a-4415d530e14f"
Sep 11 21:06:21.172779 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.172754    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:21.197411 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.197389    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.197663 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.197554    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.197663 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.197596    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f324793-6fe5-4203-80e7-edcfd9556220-crio-socket\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.197843 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.197824    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f324793-6fe5-4203-80e7-edcfd9556220-data-volume\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.197949 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.197933    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7pr\" (UniqueName: \"kubernetes.io/projected/8f324793-6fe5-4203-80e7-edcfd9556220-kube-api-access-hq7pr\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299097    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299142    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299162    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f324793-6fe5-4203-80e7-edcfd9556220-crio-socket\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299198    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f324793-6fe5-4203-80e7-edcfd9556220-data-volume\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299228    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7pr\" (UniqueName: \"kubernetes.io/projected/8f324793-6fe5-4203-80e7-edcfd9556220-kube-api-access-hq7pr\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299368 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.299253    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:06:21.299368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299308    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8f324793-6fe5-4203-80e7-edcfd9556220-crio-socket\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.299368 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.299344    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:21.799318684 +0000 UTC m=+50.390832007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : configmap "kube-rbac-proxy" not found
Sep 11 21:06:21.299610 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.299409    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:21.299610 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.299478    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:21.799461363 +0000 UTC m=+50.390974666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:21.299610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.299562    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8f324793-6fe5-4203-80e7-edcfd9556220-data-volume\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.310071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.310044    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7pr\" (UniqueName: \"kubernetes.io/projected/8f324793-6fe5-4203-80e7-edcfd9556220-kube-api-access-hq7pr\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.438715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.438631    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:21.494816 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.494787    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:21.802967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.802937    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.803092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.802996    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:21.803173 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.803106    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:21.803173 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.803130    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:06:21.803272 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.803201    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:22.803184272 +0000 UTC m=+51.394697578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : configmap "kube-rbac-proxy" not found
Sep 11 21:06:21.803272 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:21.803236    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:22.803217191 +0000 UTC m=+51.394730502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:21.863456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.863434    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:21.923159 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:21.923139    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:22.104842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.104775    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:22.104842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.104812    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:22.105276 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.104927    2585 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:06:22.105276 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.104942    2585 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd: secret "image-registry-tls" not found
Sep 11 21:06:22.105276 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.105001    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls podName:9db7cf20-a90e-4880-815d-f9b629f77af5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:38.104982276 +0000 UTC m=+66.696495582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls") pod "image-registry-7d7ff4f9fc-tnzxd" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5") : secret "image-registry-tls" not found
Sep 11 21:06:22.105276 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.105053    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:06:22.105276 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.105100    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls podName:d6164295-ad3b-4b87-a92a-00a79fb58bcc nodeName:}" failed. No retries permitted until 2026-09-11 21:06:38.105090094 +0000 UTC m=+66.696603399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls") pod "dns-default-qgv57" (UID: "d6164295-ad3b-4b87-a92a-00a79fb58bcc") : secret "dns-default-metrics-tls" not found
Sep 11 21:06:22.143391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.143373    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:06:22.143715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.143699    2585 scope.go:117] "RemoveContainer" containerID="cc1d4c88ee52f5f442759409eabca1f33f03b90fbfcdbeaf9525414963a7005d"
Sep 11 21:06:22.143875 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.143856    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ftn4h_openshift-console-operator(9cc689a1-3b4e-45c5-b63a-4415d530e14f)\"" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" podUID="9cc689a1-3b4e-45c5-b63a-4415d530e14f"
Sep 11 21:06:22.146057 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.146029    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:22.208723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.208704    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:22.416468 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.416412    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:22.416545 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.416484    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:22.809173 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.809146    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:22.809309 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:22.809186    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:22.809309 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.809267    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:22.809410 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.809312    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:06:22.809410 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.809338    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:24.8093196 +0000 UTC m=+53.400832920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:22.809410 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:22.809355    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:24.809346885 +0000 UTC m=+53.400860190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : configmap "kube-rbac-proxy" not found
Sep 11 21:06:23.147582 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.147537    2585 scope.go:117] "RemoveContainer" containerID="cc1d4c88ee52f5f442759409eabca1f33f03b90fbfcdbeaf9525414963a7005d"
Sep 11 21:06:23.147924 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:23.147683    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-ftn4h_openshift-console-operator(9cc689a1-3b4e-45c5-b63a-4415d530e14f)\"" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" podUID="9cc689a1-3b4e-45c5-b63a-4415d530e14f"
Sep 11 21:06:23.291348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.291315    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:23.390025 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.390004    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:23.451033 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.450986    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdx6l_79192859-1f89-4395-b14a-e52bee7a6950/dns-node-resolver/0.log"
Sep 11 21:06:23.464834 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.464810    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:23.892792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.892762    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:23.988982 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:23.988955    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:24.455215 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:24.455192    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dmszh_ae1c9348-76bf-4b45-90a0-35d9aa36cfe7/node-ca/0.log"
Sep 11 21:06:24.825425 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:24.825396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:24.825553 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:24.825435    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:24.825598 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:24.825557    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:24.825598 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:24.825572    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:06:24.825697 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:24.825627    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:28.825609431 +0000 UTC m=+57.417122736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:24.825697 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:24.825663    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:28.825654607 +0000 UTC m=+57.417167921 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : configmap "kube-rbac-proxy" not found
Sep 11 21:06:24.857042 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:24.857009    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzrnn_eb07137d-3e54-4088-a37a-3cf63fc4ab60/serve-healthcheck-canary/0.log"
Sep 11 21:06:24.899550 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:24.899517    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:25.655527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:25.655494    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-ckjp9_c109a323-4cea-41be-82c8-34a7d7f286cb/kube-storage-version-migrator-operator/0.log"
Sep 11 21:06:27.683584 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:27.683541    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:27.835517 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:27.835478    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:27.935838 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:27.935753    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:27.951879 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:27.951844    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:27.952037 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:27.951989    2585 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 21:06:27.952076 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:27.952051    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls podName:c34ead77-9bae-4bac-8e05-2ef00d0eb9e5 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:43.952034387 +0000 UTC m=+72.543547694 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-jjbnn" (UID: "c34ead77-9bae-4bac-8e05-2ef00d0eb9e5") : secret "samples-operator-tls" not found
Sep 11 21:06:28.053035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.052997    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:28.053192 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.053044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:28.053192 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.053094    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:28.053192 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.053185    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:44.053165033 +0000 UTC m=+72.644678351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : configmap references non-existent config key: service-ca.crt
Sep 11 21:06:28.053325 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.053226    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 21:06:28.053325 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.053252    2585 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:28.053325 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.053291    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs podName:4154bd61-7946-4587-a37e-a559590bdbd2 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:44.053275618 +0000 UTC m=+72.644788926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs") pod "router-default-7d9d59f4d8-jpdvl" (UID: "4154bd61-7946-4587-a37e-a559590bdbd2") : secret "router-metrics-certs-default" not found
Sep 11 21:06:28.053325 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.053306    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls podName:44c9aacc-e9a0-4505-862e-e202bff49aab nodeName:}" failed. No retries permitted until 2026-09-11 21:06:44.053299929 +0000 UTC m=+72.644813230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-kcrk4" (UID: "44c9aacc-e9a0-4505-862e-e202bff49aab") : secret "cluster-monitoring-operator-tls" not found
Sep 11 21:06:28.225671 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.225586    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:28.325801 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.325765    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:28.434128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.434086    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:28.859704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.859669    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:28.860104 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.859712    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:28.860104 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.859806    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:06:28.860104 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.859824    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:28.860104 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.859857    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:36.859843386 +0000 UTC m=+65.451356691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : configmap "kube-rbac-proxy" not found
Sep 11 21:06:28.860104 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:28.859895    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:36.859881544 +0000 UTC m=+65.451394849 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:28.879586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:28.879559    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:29.361309 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:29.361277    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:29.783139 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:29.783101    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:29.969784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:29.969750    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:30.172206 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:30.172120    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:30.375870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:30.375837    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:30.557010 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:30.556975    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:31.053158 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:31.053132    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xhqsv"
Sep 11 21:06:31.353402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:31.353313    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:31.455357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:31.455320    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:31.757409 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:31.757317    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:31.957003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:31.956966    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:32.169931 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:32.169894    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:32.235078 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:32.235047    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:32.560872 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:32.560836    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:33.379972 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:33.379934    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:33.711529 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:33.711442    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:33.811251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:33.811216    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:33.964440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:33.964360    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:34.066366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:34.066327    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:34.166788 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:34.166755    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:34.233164 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:34.233091    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:34.361860 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:34.361830    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:35.412445 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:35.412405    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:35.481882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:35.481853    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:35.559224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:35.559143    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:35.754275 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:35.754241    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:35.883727 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:35.883630    2585 scope.go:117] "RemoveContainer" containerID="cc1d4c88ee52f5f442759409eabca1f33f03b90fbfcdbeaf9525414963a7005d"
Sep 11 21:06:35.960317 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:35.960274    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:36.177505 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.177414    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:36.189026 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.189001    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:06:36.189179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.189052    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" event={"ID":"9cc689a1-3b4e-45c5-b63a-4415d530e14f","Type":"ContainerStarted","Data":"0a8083405d40a7ff46d7f479560a9f17e88fe9e1e4dafba3b32fc6f189ce941e"}
Sep 11 21:06:36.189332 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.189314    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:36.213722 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.213678    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h" podStartSLOduration=17.699224442 podStartE2EDuration="24.213664285s" totalImagesPullingTime="6.514439843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:36.212198196 +0000 UTC m=+64.803711518" watchObservedRunningTime="2026-09-11 21:06:36.213664285 +0000 UTC m=+64.805177615"
Sep 11 21:06:36.295269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.295240    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:36.364048 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.364016    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:36.656511 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.656484    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-ftn4h"
Sep 11 21:06:36.889321 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.889282    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:36.931815 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.931747    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:36.931815 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.931788    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:36.931979 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:36.931884    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:36.931979 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:06:36.931951    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls podName:8f324793-6fe5-4203-80e7-edcfd9556220 nodeName:}" failed. No retries permitted until 2026-09-11 21:06:52.931931236 +0000 UTC m=+81.523444551 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8cq74" (UID: "8f324793-6fe5-4203-80e7-edcfd9556220") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:06:36.932356 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:36.932339    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8f324793-6fe5-4203-80e7-edcfd9556220-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:37.040273 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.040238    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.145870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.145843    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.324353 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.324309    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.388378 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.388351    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.520072 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.520032    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.591764 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.591691    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.637355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.637329    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:37.640050 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.640028    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:06:37.650246 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.650221    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a457fc6-a504-442e-9933-c616c05738ad-metrics-certs\") pod \"network-metrics-daemon-rm2zj\" (UID: \"1a457fc6-a504-442e-9933-c616c05738ad\") " pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:37.723001 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.722978    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.738048 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.738019    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:37.738154 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.738079    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:37.740477 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.740456    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zs8l\" (UniqueName: \"kubernetes.io/projected/65adf28c-82be-49ac-b6a9-bb567956efc5-kube-api-access-6zs8l\") pod \"network-check-target-7w4fr\" (UID: \"65adf28c-82be-49ac-b6a9-bb567956efc5\") " pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:37.740830 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.740812    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:06:37.750855 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.750836    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1de3c338-5441-4be4-a5b9-10645947fc29-original-pull-secret\") pod \"global-pull-secret-syncer-dz4bj\" (UID: \"1de3c338-5441-4be4-a5b9-10645947fc29\") " pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:37.789237 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.789203    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:37.892492 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.892421    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mpnkz\""
Sep 11 21:06:37.898495 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.898476    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mwzls\""
Sep 11 21:06:37.900249 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.900231    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rm2zj"
Sep 11 21:06:37.900249 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.900242    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dz4bj"
Sep 11 21:06:37.906623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.906606    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:37.967224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:37.967166    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:38.141470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.141436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:38.141470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.141471    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:38.144070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.144007    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6164295-ad3b-4b87-a92a-00a79fb58bcc-metrics-tls\") pod \"dns-default-qgv57\" (UID: \"d6164295-ad3b-4b87-a92a-00a79fb58bcc\") " pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:38.144170 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.144103    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"image-registry-7d7ff4f9fc-tnzxd\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") " pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:38.167886 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.167861    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:38.198541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.198518    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dz4bj"]
Sep 11 21:06:38.203131 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:38.202898    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de3c338_5441_4be4_a5b9_10645947fc29.slice/crio-89a2c008c3b68b1e838a7463b6e4f732279056fbccf09b2f4e47598cfc030c7f WatchSource:0}: Error finding container 89a2c008c3b68b1e838a7463b6e4f732279056fbccf09b2f4e47598cfc030c7f: Status 404 returned error can't find the container with id 89a2c008c3b68b1e838a7463b6e4f732279056fbccf09b2f4e47598cfc030c7f
Sep 11 21:06:38.205223 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.205197    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rm2zj"]
Sep 11 21:06:38.206539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.206500    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7w4fr"]
Sep 11 21:06:38.210436 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:38.210415    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65adf28c_82be_49ac_b6a9_bb567956efc5.slice/crio-4e5d0381833dd23a295e2081f81b02b7b28df697c79af5831b904127877ac618 WatchSource:0}: Error finding container 4e5d0381833dd23a295e2081f81b02b7b28df697c79af5831b904127877ac618: Status 404 returned error can't find the container with id 4e5d0381833dd23a295e2081f81b02b7b28df697c79af5831b904127877ac618
Sep 11 21:06:38.345502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.345466    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:38.381127 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.381104    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j64xm\""
Sep 11 21:06:38.389359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.389340    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:38.408450 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.408432    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f5khd\""
Sep 11 21:06:38.416708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.416689    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:38.449211 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.449183    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:38.545575 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.545535    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:38.658807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.658760    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"]
Sep 11 21:06:38.661366 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:38.661342    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9db7cf20_a90e_4880_815d_f9b629f77af5.slice/crio-f2cbf5c6db0925bb03e7e8b06ced675adf6d090c6e5e6bfdfc5e019e0e62849e WatchSource:0}: Error finding container f2cbf5c6db0925bb03e7e8b06ced675adf6d090c6e5e6bfdfc5e019e0e62849e: Status 404 returned error can't find the container with id f2cbf5c6db0925bb03e7e8b06ced675adf6d090c6e5e6bfdfc5e019e0e62849e
Sep 11 21:06:38.689859 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.689836    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qgv57"]
Sep 11 21:06:38.692453 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:38.692429    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6164295_ad3b_4b87_a92a_00a79fb58bcc.slice/crio-3518f98956a03230d9bbfa35bc32e6e15b8c0264ab1ded158c0c98efdcfd3a3c WatchSource:0}: Error finding container 3518f98956a03230d9bbfa35bc32e6e15b8c0264ab1ded158c0c98efdcfd3a3c: Status 404 returned error can't find the container with id 3518f98956a03230d9bbfa35bc32e6e15b8c0264ab1ded158c0c98efdcfd3a3c
Sep 11 21:06:38.932611 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:38.932525    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:39.141959 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.141921    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:39.202752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.202667    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7w4fr" event={"ID":"65adf28c-82be-49ac-b6a9-bb567956efc5","Type":"ContainerStarted","Data":"c2c78e49333937a8123622a9b53b9c779181032e5027e5bc85e9fa0ca6e93521"}
Sep 11 21:06:39.202752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.202736    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7w4fr" event={"ID":"65adf28c-82be-49ac-b6a9-bb567956efc5","Type":"ContainerStarted","Data":"4e5d0381833dd23a295e2081f81b02b7b28df697c79af5831b904127877ac618"}
Sep 11 21:06:39.203450 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.203425    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:06:39.205230 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.205169    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgv57" event={"ID":"d6164295-ad3b-4b87-a92a-00a79fb58bcc","Type":"ContainerStarted","Data":"3518f98956a03230d9bbfa35bc32e6e15b8c0264ab1ded158c0c98efdcfd3a3c"}
Sep 11 21:06:39.206845 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.206785    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dz4bj" event={"ID":"1de3c338-5441-4be4-a5b9-10645947fc29","Type":"ContainerStarted","Data":"89a2c008c3b68b1e838a7463b6e4f732279056fbccf09b2f4e47598cfc030c7f"}
Sep 11 21:06:39.209302 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.209178    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" event={"ID":"9db7cf20-a90e-4880-815d-f9b629f77af5","Type":"ContainerStarted","Data":"e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d"}
Sep 11 21:06:39.209302 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.209225    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" event={"ID":"9db7cf20-a90e-4880-815d-f9b629f77af5","Type":"ContainerStarted","Data":"f2cbf5c6db0925bb03e7e8b06ced675adf6d090c6e5e6bfdfc5e019e0e62849e"}
Sep 11 21:06:39.209302 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.209259    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:06:39.210605 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.210579    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm2zj" event={"ID":"1a457fc6-a504-442e-9933-c616c05738ad","Type":"ContainerStarted","Data":"5dea29e7afc1efda5fc3b1b180948b8abcd2b51c82a0ee223e97d5c31b6dd9c1"}
Sep 11 21:06:39.221278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.221234    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7w4fr" podStartSLOduration=67.221216809 podStartE2EDuration="1m7.221216809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:39.220275668 +0000 UTC m=+67.811788992" watchObservedRunningTime="2026-09-11 21:06:39.221216809 +0000 UTC m=+67.812730131"
Sep 11 21:06:39.558918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.558886    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:39.662160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:39.662127    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:40.216816 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:40.216777    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm2zj" event={"ID":"1a457fc6-a504-442e-9933-c616c05738ad","Type":"ContainerStarted","Data":"52d49db6aa76340a4c59c2eb657b8cf4c2436c22d923abaa124f335194c4f3d8"}
Sep 11 21:06:40.217290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:40.216843    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rm2zj" event={"ID":"1a457fc6-a504-442e-9933-c616c05738ad","Type":"ContainerStarted","Data":"0391e8621197db649b04fc7834d5c5f3a0d700435bcdb5487939e371b9f245f2"}
Sep 11 21:06:40.234716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:40.234661    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rm2zj" podStartSLOduration=66.997874993 podStartE2EDuration="1m8.234616099s" totalImagesPullingTime="1.236741106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:40.234446793 +0000 UTC m=+68.825960116" watchObservedRunningTime="2026-09-11 21:06:40.234616099 +0000 UTC m=+68.826129424"
Sep 11 21:06:40.235524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:40.235481    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" podStartSLOduration=68.235472308 podStartE2EDuration="1m8.235472308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:39.245327772 +0000 UTC m=+67.836841088" watchObservedRunningTime="2026-09-11 21:06:40.235472308 +0000 UTC m=+68.826985633"
Sep 11 21:06:41.223013 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:41.222977    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgv57" event={"ID":"d6164295-ad3b-4b87-a92a-00a79fb58bcc","Type":"ContainerStarted","Data":"29a2bc6526f33ab8b512f9807c2b6c95b24ecf46887058d1825be9b06d53131f"}
Sep 11 21:06:41.223459 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:41.223125    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:41.223459 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:41.223159    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qgv57" event={"ID":"d6164295-ad3b-4b87-a92a-00a79fb58bcc","Type":"ContainerStarted","Data":"54e5c74269c671c60f7a1aead78c5bb33f2ed820184e902715ab8c36a326f8e6"}
Sep 11 21:06:41.243970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:41.243916    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qgv57" podStartSLOduration=33.401346179 podStartE2EDuration="35.24390147s" totalImagesPullingTime="1.842555291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:41.242495233 +0000 UTC m=+69.834008567" watchObservedRunningTime="2026-09-11 21:06:41.24390147 +0000 UTC m=+69.835414792"
Sep 11 21:06:43.231887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:43.231848    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dz4bj" event={"ID":"1de3c338-5441-4be4-a5b9-10645947fc29","Type":"ContainerStarted","Data":"51ec03d9d7d02f6a3b0f2a8defd8a3d6013ec3adcb83e6bf85ae8af0a0f57f6a"}
Sep 11 21:06:43.249565 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:43.249521    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dz4bj" podStartSLOduration=66.815056875 podStartE2EDuration="1m11.249503662s" totalImagesPullingTime="4.434446787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:43.247600851 +0000 UTC m=+71.839114173" watchObservedRunningTime="2026-09-11 21:06:43.249503662 +0000 UTC m=+71.841016977"
Sep 11 21:06:43.996327 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:43.996280    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:43.998698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:43.998679    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c34ead77-9bae-4bac-8e05-2ef00d0eb9e5-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-jjbnn\" (UID: \"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:44.097501 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.097472    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:44.097662 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.097507    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:44.097662 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.097549    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:44.098204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.098179    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4154bd61-7946-4587-a37e-a559590bdbd2-service-ca-bundle\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:44.099908 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.099886    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/44c9aacc-e9a0-4505-862e-e202bff49aab-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-kcrk4\" (UID: \"44c9aacc-e9a0-4505-862e-e202bff49aab\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:44.099998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.099972    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4154bd61-7946-4587-a37e-a559590bdbd2-metrics-certs\") pod \"router-default-7d9d59f4d8-jpdvl\" (UID: \"4154bd61-7946-4587-a37e-a559590bdbd2\") " pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:44.232460 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.232433    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ttg26\""
Sep 11 21:06:44.240934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.240904    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"
Sep 11 21:06:44.260393 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.260373    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-862vl\""
Sep 11 21:06:44.268437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.268413    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"
Sep 11 21:06:44.282820 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.282799    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-njr5s\""
Sep 11 21:06:44.290892 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.290547    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:44.515243 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.515131    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn"]
Sep 11 21:06:44.550338 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.550313    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4"]
Sep 11 21:06:44.553678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:44.553630    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44c9aacc_e9a0_4505_862e_e202bff49aab.slice/crio-dfc243700ad0c24414f51d61a14245d38f55d95f80b9688f306bebff7c639e4c WatchSource:0}: Error finding container dfc243700ad0c24414f51d61a14245d38f55d95f80b9688f306bebff7c639e4c: Status 404 returned error can't find the container with id dfc243700ad0c24414f51d61a14245d38f55d95f80b9688f306bebff7c639e4c
Sep 11 21:06:44.582269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.582243    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d9d59f4d8-jpdvl"]
Sep 11 21:06:44.584720 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:44.584698    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4154bd61_7946_4587_a37e_a559590bdbd2.slice/crio-b703730d4c694f23db42dca002d0fe1e279fd0a489347bf33e04dacb06303369 WatchSource:0}: Error finding container b703730d4c694f23db42dca002d0fe1e279fd0a489347bf33e04dacb06303369: Status 404 returned error can't find the container with id b703730d4c694f23db42dca002d0fe1e279fd0a489347bf33e04dacb06303369
Sep 11 21:06:44.740857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.740814    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:44.840906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:44.840869    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:45.240091 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.239998    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn" event={"ID":"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5","Type":"ContainerStarted","Data":"9a46e8c36b75e168fb19570df0034ae135467ad0afa2d675f6b42165d7a72757"}
Sep 11 21:06:45.241724 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.241688    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl" event={"ID":"4154bd61-7946-4587-a37e-a559590bdbd2","Type":"ContainerStarted","Data":"fc9dc103d408e3f3472c5ee25356e674a6e5b74198a712f4dc120add8d28031f"}
Sep 11 21:06:45.241882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.241746    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl" event={"ID":"4154bd61-7946-4587-a37e-a559590bdbd2","Type":"ContainerStarted","Data":"b703730d4c694f23db42dca002d0fe1e279fd0a489347bf33e04dacb06303369"}
Sep 11 21:06:45.243032 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.243003    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4" event={"ID":"44c9aacc-e9a0-4505-862e-e202bff49aab","Type":"ContainerStarted","Data":"dfc243700ad0c24414f51d61a14245d38f55d95f80b9688f306bebff7c639e4c"}
Sep 11 21:06:45.268094 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.268051    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl" podStartSLOduration=33.268031581 podStartE2EDuration="33.268031581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:45.26630576 +0000 UTC m=+73.857819086" watchObservedRunningTime="2026-09-11 21:06:45.268031581 +0000 UTC m=+73.859544902"
Sep 11 21:06:45.292033 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.291782    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:45.294416 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:45.294388    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:46.248105 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:46.248070    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:46.249366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:46.249343    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d9d59f4d8-jpdvl"
Sep 11 21:06:47.082365 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.082326    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:47.182942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.182910    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:47.253278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.253246    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4" event={"ID":"44c9aacc-e9a0-4505-862e-e202bff49aab","Type":"ContainerStarted","Data":"b096f9d1f029dcbf151e5633624e6829140dedf65b0439743e177a5e3acefd60"}
Sep 11 21:06:47.255116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.255090    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn" event={"ID":"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5","Type":"ContainerStarted","Data":"8e4e63ff24a9341ec86e8356b1ee5f9fc012f3f89aa9fd69f8cd75ac4386458d"}
Sep 11 21:06:47.255241 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.255137    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn" event={"ID":"c34ead77-9bae-4bac-8e05-2ef00d0eb9e5","Type":"ContainerStarted","Data":"5177fb2b5c957561ca0552e79dfae5047b72af3f0b78efa79bb7193f6df4a38f"}
Sep 11 21:06:47.266040 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.266007    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:47.273229 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.273188    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-kcrk4" podStartSLOduration=33.089757408 podStartE2EDuration="35.273172098s" totalImagesPullingTime="2.18341469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:47.272288707 +0000 UTC m=+75.863802052" watchObservedRunningTime="2026-09-11 21:06:47.273172098 +0000 UTC m=+75.864685421"
Sep 11 21:06:47.290677 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.290616    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-jjbnn" podStartSLOduration=33.101440875 podStartE2EDuration="35.29059753s" totalImagesPullingTime="2.189156655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:47.288719959 +0000 UTC m=+75.880233283" watchObservedRunningTime="2026-09-11 21:06:47.29059753 +0000 UTC m=+75.882110855"
Sep 11 21:06:47.392400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:47.392328    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:49.541744 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.541710    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"]
Sep 11 21:06:49.568773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.568745    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"]
Sep 11 21:06:49.569052 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.569037    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.572585 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.572559    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 21:06:49.575103 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.575080    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-h5b27\""
Sep 11 21:06:49.575187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.575145    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 21:06:49.575587 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.575570    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 21:06:49.576022 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.576005    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 21:06:49.592110 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.592086    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"]
Sep 11 21:06:49.614077 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.614056    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-f5zv2"]
Sep 11 21:06:49.614211 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.614193    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.617458 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.617440    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hsz46\""
Sep 11 21:06:49.617695 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.617679    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 21:06:49.617909 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.617894    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 21:06:49.636327 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.636304    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5fb5565f-l87pw"]
Sep 11 21:06:49.636471 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.636453    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:06:49.640813 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.640796    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 21:06:49.641061 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.641041    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wspqz\""
Sep 11 21:06:49.641325 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.641037    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 21:06:49.647047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.647025    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95469fa5-f8fa-42dc-a86e-5be2182eb4e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b644d8f48-gfs49\" (UID: \"95469fa5-f8fa-42dc-a86e-5be2182eb4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.647143 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.647068    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsv7q\" (UniqueName: \"kubernetes.io/projected/95469fa5-f8fa-42dc-a86e-5be2182eb4e2-kube-api-access-qsv7q\") pod \"managed-serviceaccount-addon-agent-5b644d8f48-gfs49\" (UID: \"95469fa5-f8fa-42dc-a86e-5be2182eb4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.660423 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.660399    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"]
Sep 11 21:06:49.660502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.660434    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-f5zv2"]
Sep 11 21:06:49.660502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.660455    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5fb5565f-l87pw"]
Sep 11 21:06:49.660588 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.660522    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.663916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.663897    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 21:06:49.664161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.664142    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgwp6\""
Sep 11 21:06:49.665174 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.665131    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 21:06:49.665706 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.665688    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 21:06:49.665879 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.665859    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 21:06:49.666026 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.666005    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 21:06:49.691061 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.691038    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"]
Sep 11 21:06:49.712626 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.712599    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:49.713878 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.713856    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:49.714196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.714177    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"]
Sep 11 21:06:49.715558 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.715538    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gskln\""
Sep 11 21:06:49.715668 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.715540    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 21:06:49.748251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748221    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b128a79-25a9-44e2-950d-2d78e8f2b80c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-49qvx\" (UID: \"1b128a79-25a9-44e2-950d-2d78e8f2b80c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.748354 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748281    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b128a79-25a9-44e2-950d-2d78e8f2b80c-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-49qvx\" (UID: \"1b128a79-25a9-44e2-950d-2d78e8f2b80c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.748354 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748313    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-config\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.748473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748382    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsv7q\" (UniqueName: \"kubernetes.io/projected/95469fa5-f8fa-42dc-a86e-5be2182eb4e2-kube-api-access-qsv7q\") pod \"managed-serviceaccount-addon-agent-5b644d8f48-gfs49\" (UID: \"95469fa5-f8fa-42dc-a86e-5be2182eb4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.748473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748407    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfwj5\" (UniqueName: \"kubernetes.io/projected/1983e359-6f83-4b36-bc3e-ee1bf6fd711d-kube-api-access-mfwj5\") pod \"downloads-76f99584f4-f5zv2\" (UID: \"1983e359-6f83-4b36-bc3e-ee1bf6fd711d\") " pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:06:49.748473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748427    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-service-ca\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.748596 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748482    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-oauth-config\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.748596 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-oauth-serving-cert\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.748596 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748538    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl9nf\" (UniqueName: \"kubernetes.io/projected/33665a0c-b98c-406e-a7dd-4123c2a89fd3-kube-api-access-dl9nf\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.748596 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748580    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95469fa5-f8fa-42dc-a86e-5be2182eb4e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b644d8f48-gfs49\" (UID: \"95469fa5-f8fa-42dc-a86e-5be2182eb4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.748809 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.748612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-serving-cert\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.751031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.751010    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/95469fa5-f8fa-42dc-a86e-5be2182eb4e2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b644d8f48-gfs49\" (UID: \"95469fa5-f8fa-42dc-a86e-5be2182eb4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.757357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.757338    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsv7q\" (UniqueName: \"kubernetes.io/projected/95469fa5-f8fa-42dc-a86e-5be2182eb4e2-kube-api-access-qsv7q\") pod \"managed-serviceaccount-addon-agent-5b644d8f48-gfs49\" (UID: \"95469fa5-f8fa-42dc-a86e-5be2182eb4e2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.849979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.849950    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-oauth-config\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.849979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.849979    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-oauth-serving-cert\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.850179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850002    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl9nf\" (UniqueName: \"kubernetes.io/projected/33665a0c-b98c-406e-a7dd-4123c2a89fd3-kube-api-access-dl9nf\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.850179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850051    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-serving-cert\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.850179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850076    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b128a79-25a9-44e2-950d-2d78e8f2b80c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-49qvx\" (UID: \"1b128a79-25a9-44e2-950d-2d78e8f2b80c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.850179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b128a79-25a9-44e2-950d-2d78e8f2b80c-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-49qvx\" (UID: \"1b128a79-25a9-44e2-950d-2d78e8f2b80c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.850376 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850256    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-config\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.850376 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850325    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-qldxl\" (UID: \"06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:49.850485 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850403    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfwj5\" (UniqueName: \"kubernetes.io/projected/1983e359-6f83-4b36-bc3e-ee1bf6fd711d-kube-api-access-mfwj5\") pod \"downloads-76f99584f4-f5zv2\" (UID: \"1983e359-6f83-4b36-bc3e-ee1bf6fd711d\") " pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:06:49.850485 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850435    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-service-ca\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.850897 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850870    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b128a79-25a9-44e2-950d-2d78e8f2b80c-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-49qvx\" (UID: \"1b128a79-25a9-44e2-950d-2d78e8f2b80c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.851020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.850987    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-config\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.851186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.851161    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-service-ca\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.851262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.851169    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-oauth-serving-cert\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.852607 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.852584    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-oauth-config\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.852702 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.852681    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-serving-cert\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.852750 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.852697    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b128a79-25a9-44e2-950d-2d78e8f2b80c-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-49qvx\" (UID: \"1b128a79-25a9-44e2-950d-2d78e8f2b80c\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.864470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.864449    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl9nf\" (UniqueName: \"kubernetes.io/projected/33665a0c-b98c-406e-a7dd-4123c2a89fd3-kube-api-access-dl9nf\") pod \"console-5c5fb5565f-l87pw\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") " pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:49.865540 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.865524    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfwj5\" (UniqueName: \"kubernetes.io/projected/1983e359-6f83-4b36-bc3e-ee1bf6fd711d-kube-api-access-mfwj5\") pod \"downloads-76f99584f4-f5zv2\" (UID: \"1983e359-6f83-4b36-bc3e-ee1bf6fd711d\") " pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:06:49.896691 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.896673    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"
Sep 11 21:06:49.915298 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.915265    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:49.924519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.924502    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"
Sep 11 21:06:49.945073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.945050    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:06:49.951486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.951461    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-qldxl\" (UID: \"06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:49.953878 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.953856    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-qldxl\" (UID: \"06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:49.971111 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:49.970411    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:50.020450 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.020398    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:50.023265 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.023018    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:50.108606 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.108484    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:50.194741 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.194688    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49"]
Sep 11 21:06:50.198008 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:50.197981    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95469fa5_f8fa_42dc_a86e_5be2182eb4e2.slice/crio-9375691c70c473ca5a5a1ae823d328e291679bc3ed7b7abcc3cc1e838f3ca322 WatchSource:0}: Error finding container 9375691c70c473ca5a5a1ae823d328e291679bc3ed7b7abcc3cc1e838f3ca322: Status 404 returned error can't find the container with id 9375691c70c473ca5a5a1ae823d328e291679bc3ed7b7abcc3cc1e838f3ca322
Sep 11 21:06:50.224859 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.224839    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx"]
Sep 11 21:06:50.227024 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:50.227002    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b128a79_25a9_44e2_950d_2d78e8f2b80c.slice/crio-0f3f897b249fe3885ebbd8bc887a2f227f5af44659958545f8e477209b228525 WatchSource:0}: Error finding container 0f3f897b249fe3885ebbd8bc887a2f227f5af44659958545f8e477209b228525: Status 404 returned error can't find the container with id 0f3f897b249fe3885ebbd8bc887a2f227f5af44659958545f8e477209b228525
Sep 11 21:06:50.264469 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.264442    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-f5zv2"]
Sep 11 21:06:50.267482 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.267448    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49" event={"ID":"95469fa5-f8fa-42dc-a86e-5be2182eb4e2","Type":"ContainerStarted","Data":"9375691c70c473ca5a5a1ae823d328e291679bc3ed7b7abcc3cc1e838f3ca322"}
Sep 11 21:06:50.267666 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:50.267630    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1983e359_6f83_4b36_bc3e_ee1bf6fd711d.slice/crio-ab41cf6b147975c6fdd7dbc764d6be2626f8e017100f7156da50cb40c49f8a84 WatchSource:0}: Error finding container ab41cf6b147975c6fdd7dbc764d6be2626f8e017100f7156da50cb40c49f8a84: Status 404 returned error can't find the container with id ab41cf6b147975c6fdd7dbc764d6be2626f8e017100f7156da50cb40c49f8a84
Sep 11 21:06:50.268759 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.268731    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx" event={"ID":"1b128a79-25a9-44e2-950d-2d78e8f2b80c","Type":"ContainerStarted","Data":"0f3f897b249fe3885ebbd8bc887a2f227f5af44659958545f8e477209b228525"}
Sep 11 21:06:50.295887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.295864    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5fb5565f-l87pw"]
Sep 11 21:06:50.298482 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:50.298452    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33665a0c_b98c_406e_a7dd_4123c2a89fd3.slice/crio-5afcc0140b867e91d0fab9de31f750f294ccd643fa1c5a3ca9e77e53f950b769 WatchSource:0}: Error finding container 5afcc0140b867e91d0fab9de31f750f294ccd643fa1c5a3ca9e77e53f950b769: Status 404 returned error can't find the container with id 5afcc0140b867e91d0fab9de31f750f294ccd643fa1c5a3ca9e77e53f950b769
Sep 11 21:06:50.338175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:50.338146    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"]
Sep 11 21:06:50.339972 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:50.339949    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06cdfbd9_a02a_43cf_9a08_fe6c3e9ceb0c.slice/crio-50413e4d1a3ba4b439b2611a0fbe5150a372aadf6e4bf0b33944f14b18dde201 WatchSource:0}: Error finding container 50413e4d1a3ba4b439b2611a0fbe5150a372aadf6e4bf0b33944f14b18dde201: Status 404 returned error can't find the container with id 50413e4d1a3ba4b439b2611a0fbe5150a372aadf6e4bf0b33944f14b18dde201
Sep 11 21:06:51.068430 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:51.068339    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:51.143034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:51.142983    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:51.231140 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:51.230224    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qgv57"
Sep 11 21:06:51.281093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:51.280971    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl" event={"ID":"06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c","Type":"ContainerStarted","Data":"50413e4d1a3ba4b439b2611a0fbe5150a372aadf6e4bf0b33944f14b18dde201"}
Sep 11 21:06:51.282821 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:51.282751    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-f5zv2" event={"ID":"1983e359-6f83-4b36-bc3e-ee1bf6fd711d","Type":"ContainerStarted","Data":"ab41cf6b147975c6fdd7dbc764d6be2626f8e017100f7156da50cb40c49f8a84"}
Sep 11 21:06:51.285344 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:51.285257    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5fb5565f-l87pw" event={"ID":"33665a0c-b98c-406e-a7dd-4123c2a89fd3","Type":"ContainerStarted","Data":"5afcc0140b867e91d0fab9de31f750f294ccd643fa1c5a3ca9e77e53f950b769"}
Sep 11 21:06:52.982125 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:52.982082    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:52.984852 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:52.984821    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8f324793-6fe5-4203-80e7-edcfd9556220-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8cq74\" (UID: \"8f324793-6fe5-4203-80e7-edcfd9556220\") " pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:53.216486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:53.216449    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gq824\""
Sep 11 21:06:53.224542 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:53.224511    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8cq74"
Sep 11 21:06:53.765688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:53.765614    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:53.833775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:53.833740    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:54.763819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:54.763671    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:54.864255 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:54.864191    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:55.457822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:55.457617    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:55.555745 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:55.555708    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:56.003294 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.003248    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8cq74"]
Sep 11 21:06:56.006186 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:06:56.006141    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f324793_6fe5_4203_80e7_edcfd9556220.slice/crio-ef217b9dd7ff72ea33945bd07ddd0b4c527a98507108c4c9e6520289f16e6e7e WatchSource:0}: Error finding container ef217b9dd7ff72ea33945bd07ddd0b4c527a98507108c4c9e6520289f16e6e7e: Status 404 returned error can't find the container with id ef217b9dd7ff72ea33945bd07ddd0b4c527a98507108c4c9e6520289f16e6e7e
Sep 11 21:06:56.311178 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.311139    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5fb5565f-l87pw" event={"ID":"33665a0c-b98c-406e-a7dd-4123c2a89fd3","Type":"ContainerStarted","Data":"51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525"}
Sep 11 21:06:56.313262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.313179    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx" event={"ID":"1b128a79-25a9-44e2-950d-2d78e8f2b80c","Type":"ContainerStarted","Data":"be2620c5b425f9fbabc074de2c95e777767ed3144903f27b924fb78e8392a0a8"}
Sep 11 21:06:56.315057 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.315029    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49" event={"ID":"95469fa5-f8fa-42dc-a86e-5be2182eb4e2","Type":"ContainerStarted","Data":"1324415ebc83ad165eff05ab382a3c27dcb001d0c53ff34c2e5e5fa4c922fae4"}
Sep 11 21:06:56.316891 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.316869    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl" event={"ID":"06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c","Type":"ContainerStarted","Data":"4092bb9a42b279a7b41a40a75869c707d796ae58e99e09fc6d8ea45bf76b9996"}
Sep 11 21:06:56.317062 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.317042    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:56.318880 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.318856    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cq74" event={"ID":"8f324793-6fe5-4203-80e7-edcfd9556220","Type":"ContainerStarted","Data":"44986909ebe997826d53d950d1184eeb7034cf0f9b62b0e1f24719f24dd4f51d"}
Sep 11 21:06:56.318977 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.318908    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cq74" event={"ID":"8f324793-6fe5-4203-80e7-edcfd9556220","Type":"ContainerStarted","Data":"ef217b9dd7ff72ea33945bd07ddd0b4c527a98507108c4c9e6520289f16e6e7e"}
Sep 11 21:06:56.322141 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.322104    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl"
Sep 11 21:06:56.343280 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.343213    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c5fb5565f-l87pw" podStartSLOduration=1.913620713 podStartE2EDuration="7.343197119s" totalImagesPullingTime="5.429576406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:56.341799997 +0000 UTC m=+84.933313320" watchObservedRunningTime="2026-09-11 21:06:56.343197119 +0000 UTC m=+84.934710443"
Sep 11 21:06:56.359810 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.359761    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-qldxl" podStartSLOduration=1.979969777 podStartE2EDuration="7.35974242s" totalImagesPullingTime="5.379772643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:56.358242437 +0000 UTC m=+84.949755760" watchObservedRunningTime="2026-09-11 21:06:56.35974242 +0000 UTC m=+84.951255755"
Sep 11 21:06:56.374343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.374293    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b644d8f48-gfs49" podStartSLOduration=1.8380735430000001 podStartE2EDuration="7.374277971s" totalImagesPullingTime="5.536204428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:56.37382007 +0000 UTC m=+84.965333394" watchObservedRunningTime="2026-09-11 21:06:56.374277971 +0000 UTC m=+84.965791297"
Sep 11 21:06:56.396295 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.396254    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-49qvx" podStartSLOduration=1.903655177 podStartE2EDuration="7.396241384s" totalImagesPullingTime="5.492586207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:56.394792841 +0000 UTC m=+84.986306164" watchObservedRunningTime="2026-09-11 21:06:56.396241384 +0000 UTC m=+84.987754707"
Sep 11 21:06:56.513069 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.513033    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:56.615009 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:56.614931    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:57.278807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:57.278708    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:57.325806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:57.325767    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cq74" event={"ID":"8f324793-6fe5-4203-80e7-edcfd9556220","Type":"ContainerStarted","Data":"72f5e7d96130a72e310b153068e63f85e29bc8f6791c9cac4ea2c42df879f497"}
Sep 11 21:06:57.351343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:57.351303    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:57.590152 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:57.590110    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:57.961490 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:57.961397    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:06:58.394419 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:58.394389    2585 patch_prober.go:28] interesting pod/image-registry-7d7ff4f9fc-tnzxd container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 21:06:58.394791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:58.394446    2585 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" podUID="9db7cf20-a90e-4880-815d-f9b629f77af5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:06:59.339977 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:59.339934    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8cq74" event={"ID":"8f324793-6fe5-4203-80e7-edcfd9556220","Type":"ContainerStarted","Data":"80fd963e796bd98350ca2af583b02403da33c18ad3df52b34c8ba59ad6e9431e"}
Sep 11 21:06:59.363754 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:59.362752    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8cq74" podStartSLOduration=36.159164982 podStartE2EDuration="38.362731059s" totalImagesPullingTime="2.203566077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:06:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:06:59.359057473 +0000 UTC m=+87.950570796" watchObservedRunningTime="2026-09-11 21:06:59.362731059 +0000 UTC m=+87.954244400"
Sep 11 21:06:59.971487 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:59.971449    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:59.971997 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:59.971544    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:06:59.977128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:06:59.977101    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:07:00.107693 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:00.107655    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:00.222613 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:00.222538    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:07:00.349610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:00.349584    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:07:00.458471 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:00.458436    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:00.559576 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:00.559504    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:02.418782 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.418735    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:02.640618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.640565    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:02.812791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.812735    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:02.863504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.863466    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6r9sp"]
Sep 11 21:07:02.868683 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.868656    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.871181 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.871156    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 21:07:02.871307 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.871211    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fhhrl\""
Sep 11 21:07:02.871493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.871471    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 21:07:02.871872 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.871852    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 21:07:02.871957 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.871926    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 21:07:02.874303 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874279    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-wtmp\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874411 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874323    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-sys\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874411 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874359    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-textfile\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874411 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874395    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874564 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874476    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-tls\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874564 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874558    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpqts\" (UniqueName: \"kubernetes.io/projected/83b25cef-c375-4e32-83bf-6b81b41257ce-kube-api-access-zpqts\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874611    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83b25cef-c375-4e32-83bf-6b81b41257ce-metrics-client-ca\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.874716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.874652    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-root\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.926209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.926161    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975172    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-tls\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975219    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975249    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpqts\" (UniqueName: \"kubernetes.io/projected/83b25cef-c375-4e32-83bf-6b81b41257ce-kube-api-access-zpqts\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975282    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83b25cef-c375-4e32-83bf-6b81b41257ce-metrics-client-ca\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975306    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-root\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975335    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-wtmp\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975400    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-root\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:07:02.975474    2585 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975528    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-sys\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:07:02.975565    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-tls podName:83b25cef-c375-4e32-83bf-6b81b41257ce nodeName:}" failed. No retries permitted until 2026-09-11 21:07:03.47554113 +0000 UTC m=+92.067054436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-tls") pod "node-exporter-6r9sp" (UID: "83b25cef-c375-4e32-83bf-6b81b41257ce") : secret "node-exporter-tls" not found
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975609    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-textfile\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975680    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975690    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-wtmp\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.975568    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83b25cef-c375-4e32-83bf-6b81b41257ce-sys\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.976024    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976864 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.976181    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-textfile\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.976864 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.976260    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83b25cef-c375-4e32-83bf-6b81b41257ce-metrics-client-ca\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.978332 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.978308    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:02.984377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:02.984359    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpqts\" (UniqueName: \"kubernetes.io/projected/83b25cef-c375-4e32-83bf-6b81b41257ce-kube-api-access-zpqts\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:03.019943 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.019886    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:03.117611 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.117498    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:03.217716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.217683    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:03.363873 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.363837    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:03.480905 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.480766    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-tls\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:03.483541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.483513    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83b25cef-c375-4e32-83bf-6b81b41257ce-node-exporter-tls\") pod \"node-exporter-6r9sp\" (UID: \"83b25cef-c375-4e32-83bf-6b81b41257ce\") " pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:03.780077 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.779984    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6r9sp"
Sep 11 21:07:03.791039 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.791007    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:03.906122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:03.906082    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:04.133871 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:04.130498    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:04.551959 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:04.551930    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5fb5565f-l87pw"]
Sep 11 21:07:05.625764 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:05.625729    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:05.704909 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:05.704817    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:05.794600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:05.794562    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:05.873877 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:05.873838    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:07.447103 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:07.447064    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:07.507025 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:07.506983    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:07.641959 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:07.641921    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:07.918137 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:07:07.918098    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b25cef_c375_4e32_83bf_6b81b41257ce.slice/crio-13c90336a12ae7433c6d5539f818ca363293bebe524294bbbbd2a2aa70a60cfc WatchSource:0}: Error finding container 13c90336a12ae7433c6d5539f818ca363293bebe524294bbbbd2a2aa70a60cfc: Status 404 returned error can't find the container with id 13c90336a12ae7433c6d5539f818ca363293bebe524294bbbbd2a2aa70a60cfc
Sep 11 21:07:08.385549 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:08.385324    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6r9sp" event={"ID":"83b25cef-c375-4e32-83bf-6b81b41257ce","Type":"ContainerStarted","Data":"13c90336a12ae7433c6d5539f818ca363293bebe524294bbbbd2a2aa70a60cfc"}
Sep 11 21:07:08.829208 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:08.829126    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:08.925107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:08.925067    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:09.030745 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.030701    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:09.379783 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.379743    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:09.392769 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.392733    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-f5zv2" event={"ID":"1983e359-6f83-4b36-bc3e-ee1bf6fd711d","Type":"ContainerStarted","Data":"8cc9e10be9ee2348e2ab38257ef20dd3ed5e3fda4adbdb1593849a59f95abb71"}
Sep 11 21:07:09.392939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.392908    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:07:09.395030 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.394905    2585 generic.go:356] "Generic (PLEG): container finished" podID="83b25cef-c375-4e32-83bf-6b81b41257ce" containerID="ef7352ab72a732bc638c0c3ad28358c644bc3f1da011f62c5285cefdcf33a727" exitCode=0
Sep 11 21:07:09.395030 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.394996    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6r9sp" event={"ID":"83b25cef-c375-4e32-83bf-6b81b41257ce","Type":"ContainerDied","Data":"ef7352ab72a732bc638c0c3ad28358c644bc3f1da011f62c5285cefdcf33a727"}
Sep 11 21:07:09.404919 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.404899    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-f5zv2"
Sep 11 21:07:09.413968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.413918    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-f5zv2" podStartSLOduration=2.374315995 podStartE2EDuration="20.413903831s" totalImagesPullingTime="18.039587836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:09.413141307 +0000 UTC m=+98.004654653" watchObservedRunningTime="2026-09-11 21:07:09.413903831 +0000 UTC m=+98.005417153"
Sep 11 21:07:09.461605 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:09.461568    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:10.168803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:10.168752    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:10.271379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:10.271333    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:10.403901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:10.403851    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6r9sp" event={"ID":"83b25cef-c375-4e32-83bf-6b81b41257ce","Type":"ContainerStarted","Data":"7cc16677cb4a02fdf61bc1bd6348bfd6876143c62787dd6d3c39042bce95fa88"}
Sep 11 21:07:10.404092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:10.403912    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6r9sp" event={"ID":"83b25cef-c375-4e32-83bf-6b81b41257ce","Type":"ContainerStarted","Data":"3c90b808dcd87054abeb5d0000fc496de2dd561e9e4d41015fa938bdd8e9d175"}
Sep 11 21:07:10.430829 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:10.430725    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6r9sp" podStartSLOduration=7.445908679 podStartE2EDuration="8.43070265s" totalImagesPullingTime="908.396006ms" totalInitContainerRuntime="76.397965ms" isStatefulPod=true podCreationTimestamp="2026-09-11 21:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:07:10.429097283 +0000 UTC m=+99.020610619" watchObservedRunningTime="2026-09-11 21:07:10.43070265 +0000 UTC m=+99.022215993"
Sep 11 21:07:11.226705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:11.226669    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7w4fr"
Sep 11 21:07:12.942689 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:12.942624    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:13.000035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:12.999994    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:13.485893 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:13.485854    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"]
Sep 11 21:07:13.613654 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:13.613606    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:13.717951 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:13.717778    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:14.779937 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:14.779895    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:14.893763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:14.893724    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:16.148073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:16.148031    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:16.248481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:16.248436    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:18.436420 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:18.436385    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:18.505305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:18.505273    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:19.261526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:19.261487    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:19.336337 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:19.336301    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:21.893927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:21.893890    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:22.028704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:22.028667    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:22.139196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:22.139163    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:23.586285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:23.586242    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:23.687618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:23.687574    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:23.791495 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:23.791462    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:29.573221 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.573158    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c5fb5565f-l87pw" podUID="33665a0c-b98c-406e-a7dd-4123c2a89fd3" containerName="console" containerID="cri-o://51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525" gracePeriod=15
Sep 11 21:07:29.734948 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.734912    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:29.793826 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.793787    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:29.848811 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.848758    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:07:29.907615 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.907592    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-service-ca\") pod \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") "
Sep 11 21:07:29.907775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.907634    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-serving-cert\") pod \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") "
Sep 11 21:07:29.907775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.907677    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-oauth-serving-cert\") pod \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") "
Sep 11 21:07:29.907775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.907701    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-oauth-config\") pod \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") "
Sep 11 21:07:29.907775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.907724    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dl9nf\" (UniqueName: \"kubernetes.io/projected/33665a0c-b98c-406e-a7dd-4123c2a89fd3-kube-api-access-dl9nf\") pod \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") "
Sep 11 21:07:29.907987 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.907825    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-config\") pod \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\" (UID: \"33665a0c-b98c-406e-a7dd-4123c2a89fd3\") "
Sep 11 21:07:29.908114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.908009    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-service-ca" (OuterVolumeSpecName: "service-ca") pod "33665a0c-b98c-406e-a7dd-4123c2a89fd3" (UID: "33665a0c-b98c-406e-a7dd-4123c2a89fd3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:29.908257 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.908106    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33665a0c-b98c-406e-a7dd-4123c2a89fd3" (UID: "33665a0c-b98c-406e-a7dd-4123c2a89fd3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:29.908257 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.908161    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-config" (OuterVolumeSpecName: "console-config") pod "33665a0c-b98c-406e-a7dd-4123c2a89fd3" (UID: "33665a0c-b98c-406e-a7dd-4123c2a89fd3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:29.909955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.909924    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33665a0c-b98c-406e-a7dd-4123c2a89fd3" (UID: "33665a0c-b98c-406e-a7dd-4123c2a89fd3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:29.909955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.909942    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33665a0c-b98c-406e-a7dd-4123c2a89fd3" (UID: "33665a0c-b98c-406e-a7dd-4123c2a89fd3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:29.910117 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:29.909989    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33665a0c-b98c-406e-a7dd-4123c2a89fd3-kube-api-access-dl9nf" (OuterVolumeSpecName: "kube-api-access-dl9nf") pod "33665a0c-b98c-406e-a7dd-4123c2a89fd3" (UID: "33665a0c-b98c-406e-a7dd-4123c2a89fd3"). InnerVolumeSpecName "kube-api-access-dl9nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:07:30.008742 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.008713    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-config\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:30.008742 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.008738    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:30.008742 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.008747    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-serving-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:30.008941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.008756    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33665a0c-b98c-406e-a7dd-4123c2a89fd3-oauth-serving-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:30.008941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.008766    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33665a0c-b98c-406e-a7dd-4123c2a89fd3-console-oauth-config\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:30.008941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.008777    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dl9nf\" (UniqueName: \"kubernetes.io/projected/33665a0c-b98c-406e-a7dd-4123c2a89fd3-kube-api-access-dl9nf\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:30.489510 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.489468    2585 generic.go:356] "Generic (PLEG): container finished" podID="33665a0c-b98c-406e-a7dd-4123c2a89fd3" containerID="51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525" exitCode=0
Sep 11 21:07:30.489707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.489517    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5fb5565f-l87pw"
Sep 11 21:07:30.489707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.489558    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5fb5565f-l87pw" event={"ID":"33665a0c-b98c-406e-a7dd-4123c2a89fd3","Type":"ContainerDied","Data":"51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525"}
Sep 11 21:07:30.489707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.489615    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5fb5565f-l87pw" event={"ID":"33665a0c-b98c-406e-a7dd-4123c2a89fd3","Type":"ContainerDied","Data":"5afcc0140b867e91d0fab9de31f750f294ccd643fa1c5a3ca9e77e53f950b769"}
Sep 11 21:07:30.489707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.489652    2585 scope.go:117] "RemoveContainer" containerID="51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525"
Sep 11 21:07:30.498456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.498438    2585 scope.go:117] "RemoveContainer" containerID="51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525"
Sep 11 21:07:30.498718 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:07:30.498700    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525\": container with ID starting with 51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525 not found: ID does not exist" containerID="51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525"
Sep 11 21:07:30.498783 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.498728    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525"} err="failed to get container status \"51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525\": rpc error: code = NotFound desc = could not find container \"51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525\": container with ID starting with 51933488e767bd1d683ac28855f83a91d8eb1a492426da23db144830a4000525 not found: ID does not exist"
Sep 11 21:07:30.509916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.509895    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c5fb5565f-l87pw"]
Sep 11 21:07:30.513536 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:30.513511    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c5fb5565f-l87pw"]
Sep 11 21:07:31.889102 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:31.889074    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33665a0c-b98c-406e-a7dd-4123c2a89fd3" path="/var/lib/kubelet/pods/33665a0c-b98c-406e-a7dd-4123c2a89fd3/volumes"
Sep 11 21:07:35.511120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:35.511036    2585 generic.go:356] "Generic (PLEG): container finished" podID="dad7fe4e-7346-4bb7-9bd4-627c051b169b" containerID="8d1c23db4033e5af4bfc28923cb6387b3ede0646f4165b9a96256fc1502160bc" exitCode=0
Sep 11 21:07:35.511120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:35.511108    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-vmqkc" event={"ID":"dad7fe4e-7346-4bb7-9bd4-627c051b169b","Type":"ContainerDied","Data":"8d1c23db4033e5af4bfc28923cb6387b3ede0646f4165b9a96256fc1502160bc"}
Sep 11 21:07:35.511543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:35.511434    2585 scope.go:117] "RemoveContainer" containerID="8d1c23db4033e5af4bfc28923cb6387b3ede0646f4165b9a96256fc1502160bc"
Sep 11 21:07:36.516723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:36.516685    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-vmqkc" event={"ID":"dad7fe4e-7346-4bb7-9bd4-627c051b169b","Type":"ContainerStarted","Data":"4514264869a2d16ada767d639862a2a1dcacc09f0099f3a20e489fc2f9f27574"}
Sep 11 21:07:37.637555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:37.637515    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:37.708498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:37.708461    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:38.509472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.509428    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" podUID="9db7cf20-a90e-4880-815d-f9b629f77af5" containerName="registry" containerID="cri-o://e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d" gracePeriod=30
Sep 11 21:07:38.779809 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.779752    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:07:38.884778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884742    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-trusted-ca\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.884946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884800    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-certificates\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.884946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884823    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9db7cf20-a90e-4880-815d-f9b629f77af5-ca-trust-extracted\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.884946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884842    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-bound-sa-token\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.884946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884864    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m829n\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-kube-api-access-m829n\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.885162 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884943    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-installation-pull-secrets\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.885162 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.884993    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.885256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.885157    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-image-registry-private-configuration\") pod \"9db7cf20-a90e-4880-815d-f9b629f77af5\" (UID: \"9db7cf20-a90e-4880-815d-f9b629f77af5\") "
Sep 11 21:07:38.885256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.885211    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:38.885398 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.885358    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:07:38.885520 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.885452    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-trusted-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.885520 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.885473    2585 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-certificates\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.887452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.887412    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-kube-api-access-m829n" (OuterVolumeSpecName: "kube-api-access-m829n") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "kube-api-access-m829n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:07:38.887814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.887774    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:07:38.887814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.887798    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:38.887947 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.887854    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:07:38.887947 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.887875    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:07:38.893560 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.893536    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9db7cf20-a90e-4880-815d-f9b629f77af5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9db7cf20-a90e-4880-815d-f9b629f77af5" (UID: "9db7cf20-a90e-4880-815d-f9b629f77af5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:07:38.985973 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.985944    2585 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-bound-sa-token\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.985973 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.985971    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m829n\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-kube-api-access-m829n\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.986128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.985983    2585 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-installation-pull-secrets\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.986128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.985994    2585 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9db7cf20-a90e-4880-815d-f9b629f77af5-registry-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.986128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.986003    2585 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9db7cf20-a90e-4880-815d-f9b629f77af5-image-registry-private-configuration\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:38.986128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:38.986013    2585 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9db7cf20-a90e-4880-815d-f9b629f77af5-ca-trust-extracted\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:07:39.529358 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.529323    2585 generic.go:356] "Generic (PLEG): container finished" podID="9db7cf20-a90e-4880-815d-f9b629f77af5" containerID="e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d" exitCode=0
Sep 11 21:07:39.529530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.529367    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" event={"ID":"9db7cf20-a90e-4880-815d-f9b629f77af5","Type":"ContainerDied","Data":"e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d"}
Sep 11 21:07:39.529530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.529371    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"
Sep 11 21:07:39.529530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.529409    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd" event={"ID":"9db7cf20-a90e-4880-815d-f9b629f77af5","Type":"ContainerDied","Data":"f2cbf5c6db0925bb03e7e8b06ced675adf6d090c6e5e6bfdfc5e019e0e62849e"}
Sep 11 21:07:39.529530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.529431    2585 scope.go:117] "RemoveContainer" containerID="e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d"
Sep 11 21:07:39.538003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.537986    2585 scope.go:117] "RemoveContainer" containerID="e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d"
Sep 11 21:07:39.538260 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:07:39.538240    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d\": container with ID starting with e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d not found: ID does not exist" containerID="e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d"
Sep 11 21:07:39.538320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.538269    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d"} err="failed to get container status \"e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d\": rpc error: code = NotFound desc = could not find container \"e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d\": container with ID starting with e93c1a201da6f2c376803c8e7bc68637049f61075821d1b4926fedf3868c896d not found: ID does not exist"
Sep 11 21:07:39.550661 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.550626    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"]
Sep 11 21:07:39.552861 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.552840    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d7ff4f9fc-tnzxd"]
Sep 11 21:07:39.885809 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:39.885786    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9db7cf20-a90e-4880-815d-f9b629f77af5" path="/var/lib/kubelet/pods/9db7cf20-a90e-4880-815d-f9b629f77af5/volumes"
Sep 11 21:07:40.534825 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:40.534793    2585 generic.go:356] "Generic (PLEG): container finished" podID="c109a323-4cea-41be-82c8-34a7d7f286cb" containerID="10bfff349aa5db70cec290bcf73ed566fe213729be00c75802473ae34a040e3f" exitCode=0
Sep 11 21:07:40.535011 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:40.534871    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9" event={"ID":"c109a323-4cea-41be-82c8-34a7d7f286cb","Type":"ContainerDied","Data":"10bfff349aa5db70cec290bcf73ed566fe213729be00c75802473ae34a040e3f"}
Sep 11 21:07:40.535236 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:40.535213    2585 scope.go:117] "RemoveContainer" containerID="10bfff349aa5db70cec290bcf73ed566fe213729be00c75802473ae34a040e3f"
Sep 11 21:07:41.541623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:41.541585    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-ckjp9" event={"ID":"c109a323-4cea-41be-82c8-34a7d7f286cb","Type":"ContainerStarted","Data":"79881f411304d4b8ee43aa456df915684cd0ef659886087b4c3ed367082e897d"}
Sep 11 21:07:44.746704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:44.746670    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:44.847215 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:44.847176    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:07:45.560343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:45.560262    2585 generic.go:356] "Generic (PLEG): container finished" podID="92ee312c-f236-4ed9-a55e-8eea603233ca" containerID="77e0233d517da61ebc828d4809acadbc2846f3ec9aac46cee50c444da85a440d" exitCode=0
Sep 11 21:07:45.560343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:45.560309    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz" event={"ID":"92ee312c-f236-4ed9-a55e-8eea603233ca","Type":"ContainerDied","Data":"77e0233d517da61ebc828d4809acadbc2846f3ec9aac46cee50c444da85a440d"}
Sep 11 21:07:45.560625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:45.560611    2585 scope.go:117] "RemoveContainer" containerID="77e0233d517da61ebc828d4809acadbc2846f3ec9aac46cee50c444da85a440d"
Sep 11 21:07:46.566191 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:07:46.566149    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-lmvkz" event={"ID":"92ee312c-f236-4ed9-a55e-8eea603233ca","Type":"ContainerStarted","Data":"4527e6c19edfc11a4c3069283c831b7b1c4f92eb2852d31688fe3979b4e660cd"}
Sep 11 21:08:12.469738 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:12.469697    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:18.842149 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:18.842101    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:18.909491 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:18.909455    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:26.259084 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259007    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69546474db-rbwgw"]
Sep 11 21:08:26.259569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259329    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33665a0c-b98c-406e-a7dd-4123c2a89fd3" containerName="console"
Sep 11 21:08:26.259569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259344    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="33665a0c-b98c-406e-a7dd-4123c2a89fd3" containerName="console"
Sep 11 21:08:26.259569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259369    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9db7cf20-a90e-4880-815d-f9b629f77af5" containerName="registry"
Sep 11 21:08:26.259569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259377    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9db7cf20-a90e-4880-815d-f9b629f77af5" containerName="registry"
Sep 11 21:08:26.259569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259452    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9db7cf20-a90e-4880-815d-f9b629f77af5" containerName="registry"
Sep 11 21:08:26.259569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.259464    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="33665a0c-b98c-406e-a7dd-4123c2a89fd3" containerName="console"
Sep 11 21:08:26.262478 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.262456    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.265984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.265956    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 21:08:26.265984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.265962    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 21:08:26.266207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.265990    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 21:08:26.266207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.266022    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 21:08:26.266207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.266172    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jgwp6\""
Sep 11 21:08:26.266454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.266399    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 21:08:26.270922 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.270906    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 21:08:26.275448 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.275428    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69546474db-rbwgw"]
Sep 11 21:08:26.322682 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.322621    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:26.339487 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339465    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-trusted-ca-bundle\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.339603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339496    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-oauth-config\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.339603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339520    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w9x5\" (UniqueName: \"kubernetes.io/projected/7de2f683-81d7-4af3-851b-fa13d97ad8b1-kube-api-access-8w9x5\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.339758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339620    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-serving-cert\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.339758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339684    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-service-ca\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.339758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339723    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-oauth-serving-cert\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.339865 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.339783    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-config\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.391806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.391779    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:26.440912 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.440886    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-config\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441027 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.440925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-trusted-ca-bundle\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441027 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.440944    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-oauth-config\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441132 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441056    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w9x5\" (UniqueName: \"kubernetes.io/projected/7de2f683-81d7-4af3-851b-fa13d97ad8b1-kube-api-access-8w9x5\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441132 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441101    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-serving-cert\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441132 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441121    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-service-ca\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441286 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441157    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-oauth-serving-cert\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441820 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441788    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-oauth-serving-cert\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441820 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441796    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-config\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441957 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-service-ca\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.441957 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.441919    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-trusted-ca-bundle\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.443551 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.443534    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-oauth-config\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.443627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.443610    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-serving-cert\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.450189 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.450170    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w9x5\" (UniqueName: \"kubernetes.io/projected/7de2f683-81d7-4af3-851b-fa13d97ad8b1-kube-api-access-8w9x5\") pod \"console-69546474db-rbwgw\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") " pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.572260 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.572230    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:26.842688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:26.842662    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69546474db-rbwgw"]
Sep 11 21:08:26.845118 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:08:26.845086    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de2f683_81d7_4af3_851b_fa13d97ad8b1.slice/crio-5b74cc7a240f007520c97c7a9855ce78ff9b11281412ff1a1cf0ce6cb6b1d31c WatchSource:0}: Error finding container 5b74cc7a240f007520c97c7a9855ce78ff9b11281412ff1a1cf0ce6cb6b1d31c: Status 404 returned error can't find the container with id 5b74cc7a240f007520c97c7a9855ce78ff9b11281412ff1a1cf0ce6cb6b1d31c
Sep 11 21:08:27.726948 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:27.726906    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69546474db-rbwgw" event={"ID":"7de2f683-81d7-4af3-851b-fa13d97ad8b1","Type":"ContainerStarted","Data":"aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae"}
Sep 11 21:08:27.727339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:27.726994    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69546474db-rbwgw" event={"ID":"7de2f683-81d7-4af3-851b-fa13d97ad8b1","Type":"ContainerStarted","Data":"5b74cc7a240f007520c97c7a9855ce78ff9b11281412ff1a1cf0ce6cb6b1d31c"}
Sep 11 21:08:27.753290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:27.753244    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69546474db-rbwgw" podStartSLOduration=1.753230003 podStartE2EDuration="1.753230003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:08:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:08:27.752083501 +0000 UTC m=+176.343596824" watchObservedRunningTime="2026-09-11 21:08:27.753230003 +0000 UTC m=+176.344743325"
Sep 11 21:08:30.764217 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:30.764183    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:30.861090 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:30.861058    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:36.573073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:36.573026    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:36.573519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:36.573106    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:36.578097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:36.578075    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:36.764360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:36.764331    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:08:36.939508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:36.939426    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:36.997237 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:36.997199    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:37.282485 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:37.282444    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:37.344219 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:37.344187    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:44.831394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:44.831360    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:44.941857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:44.941817    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:08:45.048512 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:08:45.048477    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:06.638224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:06.638182    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:06.700226 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:06.700189    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:07.848782 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:07.848751    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:07.920102 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:07.920059    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:17.349543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:17.349507    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:17.448154 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:17.448120    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:18.242677 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.242630    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"]
Sep 11 21:09:18.246184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.246167    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.248772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.248748    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:09:18.249010 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.248996    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:09:18.249821 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.249806    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-98x5r\""
Sep 11 21:09:18.255765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.255744    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"]
Sep 11 21:09:18.343982 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.343938    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.343982 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.343980    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.344209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.344005    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cr7t\" (UniqueName: \"kubernetes.io/projected/655668ae-2b64-416f-8bde-c426f04986b6-kube-api-access-2cr7t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.444435 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.444385    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.444435 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.444433    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.444875 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.444557    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cr7t\" (UniqueName: \"kubernetes.io/projected/655668ae-2b64-416f-8bde-c426f04986b6-kube-api-access-2cr7t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.444875 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.444803    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.444875 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.444820    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.453773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.453749    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cr7t\" (UniqueName: \"kubernetes.io/projected/655668ae-2b64-416f-8bde-c426f04986b6-kube-api-access-2cr7t\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.555414 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.555376    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:18.829251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.829088    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"]
Sep 11 21:09:18.831442 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:09:18.831407    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod655668ae_2b64_416f_8bde_c426f04986b6.slice/crio-255d29ec0314388a0f8091800d2610cef0d0f54e650bafffcccbc18eafa64b43 WatchSource:0}: Error finding container 255d29ec0314388a0f8091800d2610cef0d0f54e650bafffcccbc18eafa64b43: Status 404 returned error can't find the container with id 255d29ec0314388a0f8091800d2610cef0d0f54e650bafffcccbc18eafa64b43
Sep 11 21:09:18.923908 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:18.923872    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" event={"ID":"655668ae-2b64-416f-8bde-c426f04986b6","Type":"ContainerStarted","Data":"255d29ec0314388a0f8091800d2610cef0d0f54e650bafffcccbc18eafa64b43"}
Sep 11 21:09:26.963690 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:26.963657    2585 generic.go:356] "Generic (PLEG): container finished" podID="655668ae-2b64-416f-8bde-c426f04986b6" containerID="74571d87cc471b31153aa4a603d247f788c3f4b0e78311b85cba37b071b4d042" exitCode=0
Sep 11 21:09:26.964134 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:26.963747    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" event={"ID":"655668ae-2b64-416f-8bde-c426f04986b6","Type":"ContainerDied","Data":"74571d87cc471b31153aa4a603d247f788c3f4b0e78311b85cba37b071b4d042"}
Sep 11 21:09:30.980766 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:30.980731    2585 generic.go:356] "Generic (PLEG): container finished" podID="655668ae-2b64-416f-8bde-c426f04986b6" containerID="ab473368ffe8e0f23479146c9757b353d8b855c0742ccfff88603e9820b559c3" exitCode=0
Sep 11 21:09:30.981225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:30.980812    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" event={"ID":"655668ae-2b64-416f-8bde-c426f04986b6","Type":"ContainerDied","Data":"ab473368ffe8e0f23479146c9757b353d8b855c0742ccfff88603e9820b559c3"}
Sep 11 21:09:39.020436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:39.020385    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" event={"ID":"655668ae-2b64-416f-8bde-c426f04986b6","Type":"ContainerStarted","Data":"de176c4eb85009b9ef64ca8882ef89ea64e6f07c5fdcd3c2a6c434ab6fdad7e1"}
Sep 11 21:09:39.045148 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:39.045101    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" podStartSLOduration=2.84693498 podStartE2EDuration="21.045084475s" totalImagesPullingTime="18.198149495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:09:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:09:39.042917663 +0000 UTC m=+247.634430986" watchObservedRunningTime="2026-09-11 21:09:39.045084475 +0000 UTC m=+247.636597798"
Sep 11 21:09:40.026909 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:40.026873    2585 generic.go:356] "Generic (PLEG): container finished" podID="655668ae-2b64-416f-8bde-c426f04986b6" containerID="de176c4eb85009b9ef64ca8882ef89ea64e6f07c5fdcd3c2a6c434ab6fdad7e1" exitCode=0
Sep 11 21:09:40.027317 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:40.026956    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" event={"ID":"655668ae-2b64-416f-8bde-c426f04986b6","Type":"ContainerDied","Data":"de176c4eb85009b9ef64ca8882ef89ea64e6f07c5fdcd3c2a6c434ab6fdad7e1"}
Sep 11 21:09:41.204109 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.204071    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:41.206183 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.206160    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-bundle\") pod \"655668ae-2b64-416f-8bde-c426f04986b6\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") "
Sep 11 21:09:41.206319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.206197    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cr7t\" (UniqueName: \"kubernetes.io/projected/655668ae-2b64-416f-8bde-c426f04986b6-kube-api-access-2cr7t\") pod \"655668ae-2b64-416f-8bde-c426f04986b6\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") "
Sep 11 21:09:41.206319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.206269    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-util\") pod \"655668ae-2b64-416f-8bde-c426f04986b6\" (UID: \"655668ae-2b64-416f-8bde-c426f04986b6\") "
Sep 11 21:09:41.206893 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.206867    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-bundle" (OuterVolumeSpecName: "bundle") pod "655668ae-2b64-416f-8bde-c426f04986b6" (UID: "655668ae-2b64-416f-8bde-c426f04986b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:09:41.208829 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.208807    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/655668ae-2b64-416f-8bde-c426f04986b6-kube-api-access-2cr7t" (OuterVolumeSpecName: "kube-api-access-2cr7t") pod "655668ae-2b64-416f-8bde-c426f04986b6" (UID: "655668ae-2b64-416f-8bde-c426f04986b6"). InnerVolumeSpecName "kube-api-access-2cr7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:09:41.210189 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.210168    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-util" (OuterVolumeSpecName: "util") pod "655668ae-2b64-416f-8bde-c426f04986b6" (UID: "655668ae-2b64-416f-8bde-c426f04986b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:09:41.307311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.307277    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:09:41.307311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.307309    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/655668ae-2b64-416f-8bde-c426f04986b6-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:09:41.307311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:41.307318    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cr7t\" (UniqueName: \"kubernetes.io/projected/655668ae-2b64-416f-8bde-c426f04986b6-kube-api-access-2cr7t\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:09:42.036728 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:42.036689    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg" event={"ID":"655668ae-2b64-416f-8bde-c426f04986b6","Type":"ContainerDied","Data":"255d29ec0314388a0f8091800d2610cef0d0f54e650bafffcccbc18eafa64b43"}
Sep 11 21:09:42.036728 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:42.036737    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="255d29ec0314388a0f8091800d2610cef0d0f54e650bafffcccbc18eafa64b43"
Sep 11 21:09:42.037016 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:42.036740    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675409wzfg"
Sep 11 21:09:44.381393 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:44.381361    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:45.232340 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:45.232298    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:46.424609 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424574    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"]
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424884    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="extract"
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424895    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="extract"
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424905    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="pull"
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424911    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="pull"
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424920    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="util"
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424925    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="util"
Sep 11 21:09:46.425015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.424972    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="655668ae-2b64-416f-8bde-c426f04986b6" containerName="extract"
Sep 11 21:09:46.427484 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.427467    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.430239 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.430211    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:09:46.430335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.430218    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wm7rl\""
Sep 11 21:09:46.430335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.430275    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 21:09:46.439979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.439958    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2e52c0-130f-496f-bcc6-ba472d6d12e2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qw2h8\" (UID: \"2a2e52c0-130f-496f-bcc6-ba472d6d12e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.440086 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.439993    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgwcc\" (UniqueName: \"kubernetes.io/projected/2a2e52c0-130f-496f-bcc6-ba472d6d12e2-kube-api-access-kgwcc\") pod \"cert-manager-operator-controller-manager-55c444bf86-qw2h8\" (UID: \"2a2e52c0-130f-496f-bcc6-ba472d6d12e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.444368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.444344    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"]
Sep 11 21:09:46.541443 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.541414    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2e52c0-130f-496f-bcc6-ba472d6d12e2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qw2h8\" (UID: \"2a2e52c0-130f-496f-bcc6-ba472d6d12e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.541443 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.541450    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgwcc\" (UniqueName: \"kubernetes.io/projected/2a2e52c0-130f-496f-bcc6-ba472d6d12e2-kube-api-access-kgwcc\") pod \"cert-manager-operator-controller-manager-55c444bf86-qw2h8\" (UID: \"2a2e52c0-130f-496f-bcc6-ba472d6d12e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.541810 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.541790    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a2e52c0-130f-496f-bcc6-ba472d6d12e2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qw2h8\" (UID: \"2a2e52c0-130f-496f-bcc6-ba472d6d12e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.554002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.553968    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgwcc\" (UniqueName: \"kubernetes.io/projected/2a2e52c0-130f-496f-bcc6-ba472d6d12e2-kube-api-access-kgwcc\") pod \"cert-manager-operator-controller-manager-55c444bf86-qw2h8\" (UID: \"2a2e52c0-130f-496f-bcc6-ba472d6d12e2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:46.736969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:46.736885    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"
Sep 11 21:09:47.013574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:47.013550    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8"]
Sep 11 21:09:47.016245 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:09:47.016203    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a2e52c0_130f_496f_bcc6_ba472d6d12e2.slice/crio-12dab48f02dfffc7443c586482d6be056f01373d7e5b46d4329c2d37948a934a WatchSource:0}: Error finding container 12dab48f02dfffc7443c586482d6be056f01373d7e5b46d4329c2d37948a934a: Status 404 returned error can't find the container with id 12dab48f02dfffc7443c586482d6be056f01373d7e5b46d4329c2d37948a934a
Sep 11 21:09:47.057830 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:47.057802    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8" event={"ID":"2a2e52c0-130f-496f-bcc6-ba472d6d12e2","Type":"ContainerStarted","Data":"12dab48f02dfffc7443c586482d6be056f01373d7e5b46d4329c2d37948a934a"}
Sep 11 21:09:48.211898 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:48.211830    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:48.279055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:48.278984    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:49.068995 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:49.068955    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8" event={"ID":"2a2e52c0-130f-496f-bcc6-ba472d6d12e2","Type":"ContainerStarted","Data":"fb8af61b3d8a658365381e33ace17940a05ba6eb399d6cc88554feed17ab0063"}
Sep 11 21:09:49.094758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:49.094704    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qw2h8" podStartSLOduration=1.528082918 podStartE2EDuration="3.094689344s" totalImagesPullingTime="1.566606426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:09:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:09:49.093314608 +0000 UTC m=+257.684827931" watchObservedRunningTime="2026-09-11 21:09:49.094689344 +0000 UTC m=+257.686202682"
Sep 11 21:09:49.551157 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:49.551125    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:49.686265 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:49.686230    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:50.049926 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.049893    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"]
Sep 11 21:09:50.053336 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.053321    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.055982 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.055956    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-98x5r\""
Sep 11 21:09:50.056096 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.055956    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:09:50.056716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.056700    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:09:50.064869 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.064850    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.064958 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.064897    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.064958 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.064943    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb8wz\" (UniqueName: \"kubernetes.io/projected/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-kube-api-access-cb8wz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.067924 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.067901    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"]
Sep 11 21:09:50.165705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.165665    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.165906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.165743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.165906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.165791    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb8wz\" (UniqueName: \"kubernetes.io/projected/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-kube-api-access-cb8wz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.166046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.166005    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.166046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.166030    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.174672 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.174654    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb8wz\" (UniqueName: \"kubernetes.io/projected/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-kube-api-access-cb8wz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.362856 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.362769    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:50.476235 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.476198    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:50.576744 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.576711    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:50.637849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:50.637774    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"]
Sep 11 21:09:50.640994 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:09:50.640964    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52fc4437_5bc5_4f5d_82ff_f767a5d9f48f.slice/crio-80170f440df684a9cc9e95fb2d6c1d79802043ccd920ccbeda9e1d7f51e201cf WatchSource:0}: Error finding container 80170f440df684a9cc9e95fb2d6c1d79802043ccd920ccbeda9e1d7f51e201cf: Status 404 returned error can't find the container with id 80170f440df684a9cc9e95fb2d6c1d79802043ccd920ccbeda9e1d7f51e201cf
Sep 11 21:09:51.078991 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:51.078958    2585 generic.go:356] "Generic (PLEG): container finished" podID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerID="ff3cf5e6ecdd5a605822f0bcb927ccfd81079b8367e45501e9838020f3579a9a" exitCode=0
Sep 11 21:09:51.079168 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:51.079045    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f" event={"ID":"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f","Type":"ContainerDied","Data":"ff3cf5e6ecdd5a605822f0bcb927ccfd81079b8367e45501e9838020f3579a9a"}
Sep 11 21:09:51.079168 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:51.079094    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f" event={"ID":"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f","Type":"ContainerStarted","Data":"80170f440df684a9cc9e95fb2d6c1d79802043ccd920ccbeda9e1d7f51e201cf"}
Sep 11 21:09:52.686253 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:52.686222    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:52.887632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:52.887593    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:53.090357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.090320    2585 generic.go:356] "Generic (PLEG): container finished" podID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerID="9d67b24a33c85d3847133c60c4b737856505b5932ab4ad2fe99e63db732bb919" exitCode=0
Sep 11 21:09:53.090534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.090386    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f" event={"ID":"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f","Type":"ContainerDied","Data":"9d67b24a33c85d3847133c60c4b737856505b5932ab4ad2fe99e63db732bb919"}
Sep 11 21:09:53.157436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.157412    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"]
Sep 11 21:09:53.160503 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.160483    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.162820 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.162799    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-vm5dt\""
Sep 11 21:09:53.163379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.163357    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 21:09:53.163379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.163371    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 21:09:53.175682 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.175658    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"]
Sep 11 21:09:53.189285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.189259    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a69219b-52d2-482a-98d2-3032e98c9322-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4t9lw\" (UID: \"2a69219b-52d2-482a-98d2-3032e98c9322\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.189456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.189294    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnhp7\" (UniqueName: \"kubernetes.io/projected/2a69219b-52d2-482a-98d2-3032e98c9322-kube-api-access-jnhp7\") pod \"cert-manager-cainjector-559cdd8c87-4t9lw\" (UID: \"2a69219b-52d2-482a-98d2-3032e98c9322\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.289927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.289893    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a69219b-52d2-482a-98d2-3032e98c9322-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4t9lw\" (UID: \"2a69219b-52d2-482a-98d2-3032e98c9322\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.289927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.289930    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnhp7\" (UniqueName: \"kubernetes.io/projected/2a69219b-52d2-482a-98d2-3032e98c9322-kube-api-access-jnhp7\") pod \"cert-manager-cainjector-559cdd8c87-4t9lw\" (UID: \"2a69219b-52d2-482a-98d2-3032e98c9322\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.298628 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.298594    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2a69219b-52d2-482a-98d2-3032e98c9322-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-4t9lw\" (UID: \"2a69219b-52d2-482a-98d2-3032e98c9322\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.298749 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.298731    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnhp7\" (UniqueName: \"kubernetes.io/projected/2a69219b-52d2-482a-98d2-3032e98c9322-kube-api-access-jnhp7\") pod \"cert-manager-cainjector-559cdd8c87-4t9lw\" (UID: \"2a69219b-52d2-482a-98d2-3032e98c9322\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.470821 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.470735    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"
Sep 11 21:09:53.744440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:53.744405    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw"]
Sep 11 21:09:53.746464 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:09:53.746436    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2a69219b_52d2_482a_98d2_3032e98c9322.slice/crio-d43d68fef700ff073b78b683448b0044615cf06d6763ccacaca41dc43de3c2a1 WatchSource:0}: Error finding container d43d68fef700ff073b78b683448b0044615cf06d6763ccacaca41dc43de3c2a1: Status 404 returned error can't find the container with id d43d68fef700ff073b78b683448b0044615cf06d6763ccacaca41dc43de3c2a1
Sep 11 21:09:54.096056 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:54.096024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw" event={"ID":"2a69219b-52d2-482a-98d2-3032e98c9322","Type":"ContainerStarted","Data":"d43d68fef700ff073b78b683448b0044615cf06d6763ccacaca41dc43de3c2a1"}
Sep 11 21:09:54.098047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:54.098014    2585 generic.go:356] "Generic (PLEG): container finished" podID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerID="75a5d08877998b2bb52070620abfb878d2c15723f3b6976f33d49dd567a59f45" exitCode=0
Sep 11 21:09:54.098147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:54.098086    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f" event={"ID":"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f","Type":"ContainerDied","Data":"75a5d08877998b2bb52070620abfb878d2c15723f3b6976f33d49dd567a59f45"}
Sep 11 21:09:54.989363 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:54.989322    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:55.060398 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:55.060348    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:56.107957 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.107925    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f" event={"ID":"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f","Type":"ContainerDied","Data":"80170f440df684a9cc9e95fb2d6c1d79802043ccd920ccbeda9e1d7f51e201cf"}
Sep 11 21:09:56.108256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.107972    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="80170f440df684a9cc9e95fb2d6c1d79802043ccd920ccbeda9e1d7f51e201cf"
Sep 11 21:09:56.109324 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.109302    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:56.212263 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.212238    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-util\") pod \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") "
Sep 11 21:09:56.212384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.212287    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-bundle\") pod \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") "
Sep 11 21:09:56.212452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.212385    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb8wz\" (UniqueName: \"kubernetes.io/projected/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-kube-api-access-cb8wz\") pod \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\" (UID: \"52fc4437-5bc5-4f5d-82ff-f767a5d9f48f\") "
Sep 11 21:09:56.212773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.212743    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-bundle" (OuterVolumeSpecName: "bundle") pod "52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" (UID: "52fc4437-5bc5-4f5d-82ff-f767a5d9f48f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:09:56.214413 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.214391    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-kube-api-access-cb8wz" (OuterVolumeSpecName: "kube-api-access-cb8wz") pod "52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" (UID: "52fc4437-5bc5-4f5d-82ff-f767a5d9f48f"). InnerVolumeSpecName "kube-api-access-cb8wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:09:56.279229 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.279180    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-util" (OuterVolumeSpecName: "util") pod "52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" (UID: "52fc4437-5bc5-4f5d-82ff-f767a5d9f48f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:09:56.313300 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.313267    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb8wz\" (UniqueName: \"kubernetes.io/projected/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-kube-api-access-cb8wz\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:09:56.313300 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.313296    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:09:56.313300 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:56.313306    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/52fc4437-5bc5-4f5d-82ff-f767a5d9f48f-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:09:57.113701 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:57.113662    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw" event={"ID":"2a69219b-52d2-482a-98d2-3032e98c9322","Type":"ContainerStarted","Data":"e6e0e59296c19b65e057b3519ffc86e8c22788723c7a322d1c68519eecdefb52"}
Sep 11 21:09:57.114079 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:57.113757    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flsj2f"
Sep 11 21:09:57.131098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:57.131048    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-4t9lw" podStartSLOduration=1.724496225 podStartE2EDuration="4.131031569s" totalImagesPullingTime="2.406535344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:09:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:09:57.130392659 +0000 UTC m=+265.721905987" watchObservedRunningTime="2026-09-11 21:09:57.131031569 +0000 UTC m=+265.722544892"
Sep 11 21:09:58.855626 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:58.855589    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:09:58.912925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:09:58.912888    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:00.878772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:00.878737    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:05.211748 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:05.211710    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:05.306688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:05.306633    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:11.657426 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:11.657385    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:11.761415 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:11.761382    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:12.877442 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:12.877405    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:13.209374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209286    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"]
Sep 11 21:10:13.209714 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209696    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="pull"
Sep 11 21:10:13.209808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209716    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="pull"
Sep 11 21:10:13.209808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209736    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="util"
Sep 11 21:10:13.209808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209744    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="util"
Sep 11 21:10:13.209808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209754    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="extract"
Sep 11 21:10:13.209808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209762    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="extract"
Sep 11 21:10:13.210070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.209845    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="52fc4437-5bc5-4f5d-82ff-f767a5d9f48f" containerName="extract"
Sep 11 21:10:13.215248 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.215224    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.217705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.217685    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:10:13.217832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.217687    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:10:13.218325 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.218309    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-98x5r\""
Sep 11 21:10:13.222824 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.222576    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"]
Sep 11 21:10:13.348510 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.348466    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.348510 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.348516    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b44p5\" (UniqueName: \"kubernetes.io/projected/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-kube-api-access-b44p5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.348786 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.348667    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.450058 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.450003    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.450220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.450082    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.450220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.450114    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b44p5\" (UniqueName: \"kubernetes.io/projected/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-kube-api-access-b44p5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.450477 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.450453    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.450523 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.450460    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.458709 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.458679    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b44p5\" (UniqueName: \"kubernetes.io/projected/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-kube-api-access-b44p5\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.526374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.526301    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:13.796245 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:13.796164    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"]
Sep 11 21:10:13.798508 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:13.798472    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d35fa5_53bb_4ba8_95e9_972ddf4c0e4f.slice/crio-e28676fe0d32c8d1cc9a3104cfa0c577af1c5c7ad0f2d6d74820c431aff68d46 WatchSource:0}: Error finding container e28676fe0d32c8d1cc9a3104cfa0c577af1c5c7ad0f2d6d74820c431aff68d46: Status 404 returned error can't find the container with id e28676fe0d32c8d1cc9a3104cfa0c577af1c5c7ad0f2d6d74820c431aff68d46
Sep 11 21:10:14.085219 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:14.085126    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:14.188453 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:14.188417    2585 generic.go:356] "Generic (PLEG): container finished" podID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerID="d8e22da44a59c5b6b24eb6c0d7ba336d52bb21e7815cdaf0c804139aabf885f4" exitCode=0
Sep 11 21:10:14.188629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:14.188502    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f" event={"ID":"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f","Type":"ContainerDied","Data":"d8e22da44a59c5b6b24eb6c0d7ba336d52bb21e7815cdaf0c804139aabf885f4"}
Sep 11 21:10:14.188629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:14.188558    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f" event={"ID":"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f","Type":"ContainerStarted","Data":"e28676fe0d32c8d1cc9a3104cfa0c577af1c5c7ad0f2d6d74820c431aff68d46"}
Sep 11 21:10:15.195165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:15.195131    2585 generic.go:356] "Generic (PLEG): container finished" podID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerID="56b10f6257fbff21cda3600673f960df4a2b67476d1f3c3d0ebef89d92876fc8" exitCode=0
Sep 11 21:10:15.195616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:15.195220    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f" event={"ID":"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f","Type":"ContainerDied","Data":"56b10f6257fbff21cda3600673f960df4a2b67476d1f3c3d0ebef89d92876fc8"}
Sep 11 21:10:16.201292 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:16.201256    2585 generic.go:356] "Generic (PLEG): container finished" podID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerID="3130e0174aea3cbcd7e9b67c6f8f59b244aa511a6702607b1f2e0dc2cc0edd29" exitCode=0
Sep 11 21:10:16.201767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:16.201342    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f" event={"ID":"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f","Type":"ContainerDied","Data":"3130e0174aea3cbcd7e9b67c6f8f59b244aa511a6702607b1f2e0dc2cc0edd29"}
Sep 11 21:10:17.337752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.337728    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:17.383315 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.383279    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b44p5\" (UniqueName: \"kubernetes.io/projected/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-kube-api-access-b44p5\") pod \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") "
Sep 11 21:10:17.383501 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.383331    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-bundle\") pod \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") "
Sep 11 21:10:17.383501 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.383432    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-util\") pod \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\" (UID: \"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f\") "
Sep 11 21:10:17.384108 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.384074    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-bundle" (OuterVolumeSpecName: "bundle") pod "c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" (UID: "c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:10:17.385438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.385413    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-kube-api-access-b44p5" (OuterVolumeSpecName: "kube-api-access-b44p5") pod "c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" (UID: "c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f"). InnerVolumeSpecName "kube-api-access-b44p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:10:17.389023 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.388982    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-util" (OuterVolumeSpecName: "util") pod "c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" (UID: "c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:10:17.484197 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.484100    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:10:17.484197 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.484137    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b44p5\" (UniqueName: \"kubernetes.io/projected/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-kube-api-access-b44p5\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:10:17.484197 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:17.484149    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:10:18.216481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:18.216404    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f"
Sep 11 21:10:18.216481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:18.216414    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affsw4f" event={"ID":"c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f","Type":"ContainerDied","Data":"e28676fe0d32c8d1cc9a3104cfa0c577af1c5c7ad0f2d6d74820c431aff68d46"}
Sep 11 21:10:18.216481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:18.216462    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e28676fe0d32c8d1cc9a3104cfa0c577af1c5c7ad0f2d6d74820c431aff68d46"
Sep 11 21:10:22.670473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:22.670438    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:24.019268 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019234    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"]
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019540    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="extract"
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019551    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="extract"
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019563    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="util"
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019569    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="util"
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019581    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="pull"
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019586    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="pull"
Sep 11 21:10:24.019648 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.019651    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9d35fa5-53bb-4ba8-95e9-972ddf4c0e4f" containerName="extract"
Sep 11 21:10:24.022560 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.022541    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.028383 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.028359    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:10:24.028513 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.028379    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:10:24.029095 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.029078    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-98x5r\""
Sep 11 21:10:24.031690 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.031668    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"]
Sep 11 21:10:24.139475 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.139438    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.139632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.139503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp4hh\" (UniqueName: \"kubernetes.io/projected/b7f713bc-bb0e-4e93-8878-dc59fb277370-kube-api-access-lp4hh\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.139632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.139532    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.239945 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.239912    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.240116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.239970    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp4hh\" (UniqueName: \"kubernetes.io/projected/b7f713bc-bb0e-4e93-8878-dc59fb277370-kube-api-access-lp4hh\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.240116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.239996    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.240402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.240365    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.240470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.240372    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.269925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.269855    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp4hh\" (UniqueName: \"kubernetes.io/projected/b7f713bc-bb0e-4e93-8878-dc59fb277370-kube-api-access-lp4hh\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.337871 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.337838    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:24.609419 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:24.609365    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"]
Sep 11 21:10:24.612200 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:24.612173    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f713bc_bb0e_4e93_8878_dc59fb277370.slice/crio-e5cc127aae4ee9a1d867adce27da36d9037f9af4be30e5781c8ac3a78bc76b99 WatchSource:0}: Error finding container e5cc127aae4ee9a1d867adce27da36d9037f9af4be30e5781c8ac3a78bc76b99: Status 404 returned error can't find the container with id e5cc127aae4ee9a1d867adce27da36d9037f9af4be30e5781c8ac3a78bc76b99
Sep 11 21:10:25.119416 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:25.119383    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:25.217292 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:25.217239    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:25.248630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:25.248598    2585 generic.go:356] "Generic (PLEG): container finished" podID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerID="86edd70a6fea13851ffed45428cab85827f8907e3b2e4e0608634dbe49f89bcb" exitCode=0
Sep 11 21:10:25.248803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:25.248672    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn" event={"ID":"b7f713bc-bb0e-4e93-8878-dc59fb277370","Type":"ContainerDied","Data":"86edd70a6fea13851ffed45428cab85827f8907e3b2e4e0608634dbe49f89bcb"}
Sep 11 21:10:25.248803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:25.248709    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn" event={"ID":"b7f713bc-bb0e-4e93-8878-dc59fb277370","Type":"ContainerStarted","Data":"e5cc127aae4ee9a1d867adce27da36d9037f9af4be30e5781c8ac3a78bc76b99"}
Sep 11 21:10:25.802498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:25.802469    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.008922 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.008831    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.109685 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.109630    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.142613 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.142576    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"]
Sep 11 21:10:26.145968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.145948    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.148494 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.148473    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 21:10:26.148789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.148500    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7vdb9\""
Sep 11 21:10:26.148789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.148500    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 21:10:26.148789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.148755    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 21:10:26.149008 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.148989    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 21:10:26.175533 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.175503    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"]
Sep 11 21:10:26.254547 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.254515    2585 generic.go:356] "Generic (PLEG): container finished" podID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerID="bffe112549f43dc385e2acf9a1f8b692a5efc2950871d587794f4ebc10953f94" exitCode=0
Sep 11 21:10:26.254767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.254569    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn" event={"ID":"b7f713bc-bb0e-4e93-8878-dc59fb277370","Type":"ContainerDied","Data":"bffe112549f43dc385e2acf9a1f8b692a5efc2950871d587794f4ebc10953f94"}
Sep 11 21:10:26.256568 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.256550    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90bd7345-dc5d-49a9-96aa-bf77224afd87-webhook-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.256632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.256593    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90bd7345-dc5d-49a9-96aa-bf77224afd87-manifests\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.256632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.256614    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90bd7345-dc5d-49a9-96aa-bf77224afd87-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.256714 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.256649    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxdf\" (UniqueName: \"kubernetes.io/projected/90bd7345-dc5d-49a9-96aa-bf77224afd87-kube-api-access-6sxdf\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.256714 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.256689    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90bd7345-dc5d-49a9-96aa-bf77224afd87-tmp\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.303194 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.303163    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.357956 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.357908    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90bd7345-dc5d-49a9-96aa-bf77224afd87-manifests\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.357956 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.357960    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90bd7345-dc5d-49a9-96aa-bf77224afd87-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.358204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.358134    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxdf\" (UniqueName: \"kubernetes.io/projected/90bd7345-dc5d-49a9-96aa-bf77224afd87-kube-api-access-6sxdf\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.358265 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.358223    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90bd7345-dc5d-49a9-96aa-bf77224afd87-tmp\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.358326 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.358271    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/90bd7345-dc5d-49a9-96aa-bf77224afd87-manifests\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.358326 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.358294    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90bd7345-dc5d-49a9-96aa-bf77224afd87-webhook-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.360444 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.360421    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90bd7345-dc5d-49a9-96aa-bf77224afd87-tmp\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.360700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.360678    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/90bd7345-dc5d-49a9-96aa-bf77224afd87-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.360763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.360717    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/90bd7345-dc5d-49a9-96aa-bf77224afd87-webhook-cert\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.367188 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.367163    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxdf\" (UniqueName: \"kubernetes.io/projected/90bd7345-dc5d-49a9-96aa-bf77224afd87-kube-api-access-6sxdf\") pod \"opendatahub-operator-controller-manager-8457b95c77-ppjm7\" (UID: \"90bd7345-dc5d-49a9-96aa-bf77224afd87\") " pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.407674 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.407614    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.456263 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.456234    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:26.504005 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.503969    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.637702 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.637663    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.738364 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.738347    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"]
Sep 11 21:10:26.740526 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:26.740500    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90bd7345_dc5d_49a9_96aa_bf77224afd87.slice/crio-35452fc1f781e59143b6f07e490257e43cd737ad72d1fbeb3a72bf99f7b66550 WatchSource:0}: Error finding container 35452fc1f781e59143b6f07e490257e43cd737ad72d1fbeb3a72bf99f7b66550: Status 404 returned error can't find the container with id 35452fc1f781e59143b6f07e490257e43cd737ad72d1fbeb3a72bf99f7b66550
Sep 11 21:10:26.763193 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.763152    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:26.863091 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:26.863065    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:27.261844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:27.261803    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7" event={"ID":"90bd7345-dc5d-49a9-96aa-bf77224afd87","Type":"ContainerStarted","Data":"35452fc1f781e59143b6f07e490257e43cd737ad72d1fbeb3a72bf99f7b66550"}
Sep 11 21:10:27.263849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:27.263824    2585 generic.go:356] "Generic (PLEG): container finished" podID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerID="07819a5e71eb84b0961b745ff87c2c0c39850b35daee9dd565fd98c871ab4e2a" exitCode=0
Sep 11 21:10:27.263986 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:27.263887    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn" event={"ID":"b7f713bc-bb0e-4e93-8878-dc59fb277370","Type":"ContainerDied","Data":"07819a5e71eb84b0961b745ff87c2c0c39850b35daee9dd565fd98c871ab4e2a"}
Sep 11 21:10:29.796437 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.796416    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:29.890777 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.890755    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp4hh\" (UniqueName: \"kubernetes.io/projected/b7f713bc-bb0e-4e93-8878-dc59fb277370-kube-api-access-lp4hh\") pod \"b7f713bc-bb0e-4e93-8878-dc59fb277370\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") "
Sep 11 21:10:29.890870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.890809    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-util\") pod \"b7f713bc-bb0e-4e93-8878-dc59fb277370\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") "
Sep 11 21:10:29.890870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.890850    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-bundle\") pod \"b7f713bc-bb0e-4e93-8878-dc59fb277370\" (UID: \"b7f713bc-bb0e-4e93-8878-dc59fb277370\") "
Sep 11 21:10:29.891591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.891564    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-bundle" (OuterVolumeSpecName: "bundle") pod "b7f713bc-bb0e-4e93-8878-dc59fb277370" (UID: "b7f713bc-bb0e-4e93-8878-dc59fb277370"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:10:29.892751 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.892727    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f713bc-bb0e-4e93-8878-dc59fb277370-kube-api-access-lp4hh" (OuterVolumeSpecName: "kube-api-access-lp4hh") pod "b7f713bc-bb0e-4e93-8878-dc59fb277370" (UID: "b7f713bc-bb0e-4e93-8878-dc59fb277370"). InnerVolumeSpecName "kube-api-access-lp4hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:10:29.896348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.896310    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-util" (OuterVolumeSpecName: "util") pod "b7f713bc-bb0e-4e93-8878-dc59fb277370" (UID: "b7f713bc-bb0e-4e93-8878-dc59fb277370"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:10:29.991768 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.991728    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:10:29.991768 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.991762    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp4hh\" (UniqueName: \"kubernetes.io/projected/b7f713bc-bb0e-4e93-8878-dc59fb277370-kube-api-access-lp4hh\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:10:29.991768 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:29.991772    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b7f713bc-bb0e-4e93-8878-dc59fb277370-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:10:30.281388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:30.281353    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7" event={"ID":"90bd7345-dc5d-49a9-96aa-bf77224afd87","Type":"ContainerStarted","Data":"8d6312e0379f58136f988724700d3fd87577cbde24b43d5c2d3265f22a68757d"}
Sep 11 21:10:30.283255 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:30.283233    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn"
Sep 11 21:10:30.283368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:30.283265    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0mkhcn" event={"ID":"b7f713bc-bb0e-4e93-8878-dc59fb277370","Type":"ContainerDied","Data":"e5cc127aae4ee9a1d867adce27da36d9037f9af4be30e5781c8ac3a78bc76b99"}
Sep 11 21:10:30.283368 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:30.283303    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5cc127aae4ee9a1d867adce27da36d9037f9af4be30e5781c8ac3a78bc76b99"
Sep 11 21:10:31.289469 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.289435    2585 generic.go:356] "Generic (PLEG): container finished" podID="90bd7345-dc5d-49a9-96aa-bf77224afd87" containerID="8d6312e0379f58136f988724700d3fd87577cbde24b43d5c2d3265f22a68757d" exitCode=0
Sep 11 21:10:31.289944 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.289522    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7" event={"ID":"90bd7345-dc5d-49a9-96aa-bf77224afd87","Type":"ContainerDied","Data":"8d6312e0379f58136f988724700d3fd87577cbde24b43d5c2d3265f22a68757d"}
Sep 11 21:10:31.829246 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.829213    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:10:31.834926 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.834901    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:10:31.842919 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.842844    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:10:31.848869 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.848796    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:10:31.851156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:31.851136    2585 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 21:10:32.295887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:32.295851    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7" event={"ID":"90bd7345-dc5d-49a9-96aa-bf77224afd87","Type":"ContainerStarted","Data":"fa61ea4440431db8f926a0746c37d058f89cb9ead713b19b16ffcbbe6bbd2aad"}
Sep 11 21:10:32.298241 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:32.295935    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:32.326769 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:32.326722    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7" podStartSLOduration=1.8308871180000001 podStartE2EDuration="6.326708173s" totalImagesPullingTime="3.395050071s" totalInitContainerRuntime="1.100770984s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:32.325691734 +0000 UTC m=+300.917205054" watchObservedRunningTime="2026-09-11 21:10:32.326708173 +0000 UTC m=+300.918221509"
Sep 11 21:10:38.429899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:38.429867    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:39.638168 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:39.638123    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:43.303726 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:43.303685    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8457b95c77-ppjm7"
Sep 11 21:10:45.243469 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.243425    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:45.488348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.488310    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:45.752158 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752133    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"]
Sep 11 21:10:45.752484 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752469    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="util"
Sep 11 21:10:45.752530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752486    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="util"
Sep 11 21:10:45.752530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752507    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="pull"
Sep 11 21:10:45.752530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752513    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="pull"
Sep 11 21:10:45.752625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752533    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="extract"
Sep 11 21:10:45.752625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752539    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="extract"
Sep 11 21:10:45.752625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.752597    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7f713bc-bb0e-4e93-8878-dc59fb277370" containerName="extract"
Sep 11 21:10:45.766076 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.766051    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:45.770623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.770596    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 21:10:45.770748 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.770596    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jncg9\""
Sep 11 21:10:45.770748 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.770599    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 21:10:45.775948 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.775924    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:45.791927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.791904    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"]
Sep 11 21:10:45.904263 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.904237    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c2b4\" (UniqueName: \"kubernetes.io/projected/57819acd-2e12-4c03-999b-7b5dab70287a-kube-api-access-2c2b4\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:45.904388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.904274    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57819acd-2e12-4c03-999b-7b5dab70287a-tmp\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:45.904388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.904312    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57819acd-2e12-4c03-999b-7b5dab70287a-tls-certs\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:45.914254 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:45.914226    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:46.004864 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.004808    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c2b4\" (UniqueName: \"kubernetes.io/projected/57819acd-2e12-4c03-999b-7b5dab70287a-kube-api-access-2c2b4\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.004864 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.004839    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57819acd-2e12-4c03-999b-7b5dab70287a-tmp\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.004864 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.004863    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57819acd-2e12-4c03-999b-7b5dab70287a-tls-certs\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.007157 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.007130    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57819acd-2e12-4c03-999b-7b5dab70287a-tmp\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.007255 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.007207    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57819acd-2e12-4c03-999b-7b5dab70287a-tls-certs\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.025588 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.025569    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c2b4\" (UniqueName: \"kubernetes.io/projected/57819acd-2e12-4c03-999b-7b5dab70287a-kube-api-access-2c2b4\") pod \"kube-auth-proxy-677bd9b6b8-b9ttr\" (UID: \"57819acd-2e12-4c03-999b-7b5dab70287a\") " pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.075679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.075657    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"
Sep 11 21:10:46.365661 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.365622    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr"]
Sep 11 21:10:46.367839 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:46.367810    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57819acd_2e12_4c03_999b_7b5dab70287a.slice/crio-961b18cb1aa1d247749b3230e5ffd8a44830280079a3d32db0b4a10c9164f507 WatchSource:0}: Error finding container 961b18cb1aa1d247749b3230e5ffd8a44830280079a3d32db0b4a10c9164f507: Status 404 returned error can't find the container with id 961b18cb1aa1d247749b3230e5ffd8a44830280079a3d32db0b4a10c9164f507
Sep 11 21:10:46.369623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:46.369606    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:10:47.368396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.368360    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr" event={"ID":"57819acd-2e12-4c03-999b-7b5dab70287a","Type":"ContainerStarted","Data":"961b18cb1aa1d247749b3230e5ffd8a44830280079a3d32db0b4a10c9164f507"}
Sep 11 21:10:47.928124 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.928086    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:47.936398 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.934906    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"]
Sep 11 21:10:47.942169 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.942144    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:47.945540 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.945515    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 21:10:47.945791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.945772    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 21:10:47.945974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.945951    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 21:10:47.946094 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.945796    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 21:10:47.946591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.946572    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b426h\""
Sep 11 21:10:47.957938 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:47.957919    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"]
Sep 11 21:10:48.006252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.006212    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:48.021199 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021165    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.021331 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021226    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.021331 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021279    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lszq9\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-kube-api-access-lszq9\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.021456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021381    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.021456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021434    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4f9f1-1126-4781-b914-19302171fa6c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.021564 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021472    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.021564 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.021500    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.122730 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122691    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.122903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122747    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lszq9\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-kube-api-access-lszq9\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.122903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122796    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.122903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122836    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4f9f1-1126-4781-b914-19302171fa6c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.122903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122894    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.123127 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.123127 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.122961    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.123575 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.123542    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.125573 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.125543    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.125822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.125776    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4f9f1-1126-4781-b914-19302171fa6c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.125822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.125775    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.125955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.125851    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.141084 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.141056    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.141526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.141502    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lszq9\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-kube-api-access-lszq9\") pod \"istiod-openshift-gateway-7b7995d5cd-8v4sx\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:48.255850 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:48.255780    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:49.081508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:49.081473    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:49.379215 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:49.379144    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr" event={"ID":"57819acd-2e12-4c03-999b-7b5dab70287a","Type":"ContainerStarted","Data":"dd8a5353363efd126f783b41e0d5e031b01d53e5c77b48f9a681d989b8fbeb8e"}
Sep 11 21:10:49.401190 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:49.401144    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-677bd9b6b8-b9ttr" podStartSLOduration=1.511513945 podStartE2EDuration="4.40113007s" totalImagesPullingTime="2.889616125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:49.400090754 +0000 UTC m=+317.991604078" watchObservedRunningTime="2026-09-11 21:10:49.40113007 +0000 UTC m=+317.992643394"
Sep 11 21:10:49.466036 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:49.466002    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"]
Sep 11 21:10:49.468145 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:49.468116    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf4f9f1_1126_4781_b914_19302171fa6c.slice/crio-775afe5cc14f2dd4763cee9050399d3ea4d7581865e30b83bdd0126574afb6ea WatchSource:0}: Error finding container 775afe5cc14f2dd4763cee9050399d3ea4d7581865e30b83bdd0126574afb6ea: Status 404 returned error can't find the container with id 775afe5cc14f2dd4763cee9050399d3ea4d7581865e30b83bdd0126574afb6ea
Sep 11 21:10:50.386875 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:50.386803    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" event={"ID":"baf4f9f1-1126-4781-b914-19302171fa6c","Type":"ContainerStarted","Data":"775afe5cc14f2dd4763cee9050399d3ea4d7581865e30b83bdd0126574afb6ea"}
Sep 11 21:10:51.830397 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:51.830358    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:10:51.830689 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:51.830427    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:10:52.403068 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.403020    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" event={"ID":"baf4f9f1-1126-4781-b914-19302171fa6c","Type":"ContainerStarted","Data":"1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd"}
Sep 11 21:10:52.403298 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.403269    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:52.405689 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.405624    2585 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-8v4sx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:10:52.405807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.405719    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" podUID="baf4f9f1-1126-4781-b914-19302171fa6c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:10:52.431446 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.431378    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" podStartSLOduration=3.071524617 podStartE2EDuration="5.431357788s" totalImagesPullingTime="2.359833171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:10:52.428414455 +0000 UTC m=+321.019927781" watchObservedRunningTime="2026-09-11 21:10:52.431357788 +0000 UTC m=+321.022871113"
Sep 11 21:10:52.452664 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.452563    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:52.526102 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.526059    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:52.746733 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.746632    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:52.868522 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.868484    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:52.967906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:52.967875    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:53.408005 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:53.407976    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:10:56.223026 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.222986    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4bln"]
Sep 11 21:10:56.226339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.226315    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.228899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.228879    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 21:10:56.229012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.228974    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7pd9l\""
Sep 11 21:10:56.237663 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.237609    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4bln"]
Sep 11 21:10:56.249977 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.249943    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:56.351526 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.351490    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:56.394473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.394451    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f0c1bbf-723d-4869-950d-2c177a551ba6-cert\") pod \"odh-model-controller-7998c67dc4-z4bln\" (UID: \"3f0c1bbf-723d-4869-950d-2c177a551ba6\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.394592 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.394493    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgxsw\" (UniqueName: \"kubernetes.io/projected/3f0c1bbf-723d-4869-950d-2c177a551ba6-kube-api-access-hgxsw\") pod \"odh-model-controller-7998c67dc4-z4bln\" (UID: \"3f0c1bbf-723d-4869-950d-2c177a551ba6\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.450752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.450722    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:56.495774 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.495720    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f0c1bbf-723d-4869-950d-2c177a551ba6-cert\") pod \"odh-model-controller-7998c67dc4-z4bln\" (UID: \"3f0c1bbf-723d-4869-950d-2c177a551ba6\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.495774 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.495761    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgxsw\" (UniqueName: \"kubernetes.io/projected/3f0c1bbf-723d-4869-950d-2c177a551ba6-kube-api-access-hgxsw\") pod \"odh-model-controller-7998c67dc4-z4bln\" (UID: \"3f0c1bbf-723d-4869-950d-2c177a551ba6\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.498210 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.498188    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f0c1bbf-723d-4869-950d-2c177a551ba6-cert\") pod \"odh-model-controller-7998c67dc4-z4bln\" (UID: \"3f0c1bbf-723d-4869-950d-2c177a551ba6\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.503472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.503453    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgxsw\" (UniqueName: \"kubernetes.io/projected/3f0c1bbf-723d-4869-950d-2c177a551ba6-kube-api-access-hgxsw\") pod \"odh-model-controller-7998c67dc4-z4bln\" (UID: \"3f0c1bbf-723d-4869-950d-2c177a551ba6\") " pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.537396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.537372    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:10:56.552473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.552454    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:56.749001 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.748925    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5kgnj"]
Sep 11 21:10:56.752461 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.752433    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:56.754897 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.754876    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 21:10:56.764587 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.764561    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5kgnj"]
Sep 11 21:10:56.774032 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.774000    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:56.815296 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.815216    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-z4bln"]
Sep 11 21:10:56.817368 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:56.817344    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f0c1bbf_723d_4869_950d_2c177a551ba6.slice/crio-f1b5f106cd87604c5573310dd19200fb198bf10a3afab81ff67cad5351b21dca WatchSource:0}: Error finding container f1b5f106cd87604c5573310dd19200fb198bf10a3afab81ff67cad5351b21dca: Status 404 returned error can't find the container with id f1b5f106cd87604c5573310dd19200fb198bf10a3afab81ff67cad5351b21dca
Sep 11 21:10:56.899629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.899603    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-249k6\" (UniqueName: \"kubernetes.io/projected/1b6d7897-52e6-43b9-9494-f8363b2dd88e-kube-api-access-249k6\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:56.899738 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:56.899704    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6d7897-52e6-43b9-9494-f8363b2dd88e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.000124 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.000074    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6d7897-52e6-43b9-9494-f8363b2dd88e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.000232 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.000145    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-249k6\" (UniqueName: \"kubernetes.io/projected/1b6d7897-52e6-43b9-9494-f8363b2dd88e-kube-api-access-249k6\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.000296 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:10:57.000240    2585 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 11 21:10:57.000352 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:10:57.000320    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b6d7897-52e6-43b9-9494-f8363b2dd88e-tls-certs podName:1b6d7897-52e6-43b9-9494-f8363b2dd88e nodeName:}" failed. No retries permitted until 2026-09-11 21:10:57.500300283 +0000 UTC m=+326.091813605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1b6d7897-52e6-43b9-9494-f8363b2dd88e-tls-certs") pod "model-serving-api-54d89bd5fc-5kgnj" (UID: "1b6d7897-52e6-43b9-9494-f8363b2dd88e") : secret "model-serving-api-tls" not found
Sep 11 21:10:57.008313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.008295    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-249k6\" (UniqueName: \"kubernetes.io/projected/1b6d7897-52e6-43b9-9494-f8363b2dd88e-kube-api-access-249k6\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.110440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.110417    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:10:57.428979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.428939    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln" event={"ID":"3f0c1bbf-723d-4869-950d-2c177a551ba6","Type":"ContainerStarted","Data":"f1b5f106cd87604c5573310dd19200fb198bf10a3afab81ff67cad5351b21dca"}
Sep 11 21:10:57.504335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.504301    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6d7897-52e6-43b9-9494-f8363b2dd88e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.507937 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.507899    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b6d7897-52e6-43b9-9494-f8363b2dd88e-tls-certs\") pod \"model-serving-api-54d89bd5fc-5kgnj\" (UID: \"1b6d7897-52e6-43b9-9494-f8363b2dd88e\") " pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.663170 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.663131    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:10:57.949153 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:57.949084    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5kgnj"]
Sep 11 21:10:57.952286 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:10:57.952241    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6d7897_52e6_43b9_9494_f8363b2dd88e.slice/crio-407dce5d0af815274e819d3675083d510494a722ef79cae229d25005b162309b WatchSource:0}: Error finding container 407dce5d0af815274e819d3675083d510494a722ef79cae229d25005b162309b: Status 404 returned error can't find the container with id 407dce5d0af815274e819d3675083d510494a722ef79cae229d25005b162309b
Sep 11 21:10:58.436077 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:10:58.436036    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj" event={"ID":"1b6d7897-52e6-43b9-9494-f8363b2dd88e","Type":"ContainerStarted","Data":"407dce5d0af815274e819d3675083d510494a722ef79cae229d25005b162309b"}
Sep 11 21:11:00.447119 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:00.447085    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln" event={"ID":"3f0c1bbf-723d-4869-950d-2c177a551ba6","Type":"ContainerStarted","Data":"e025b9a6055cf2ca596cb325fd353eb88f861d483940988daf319d61f71d9a83"}
Sep 11 21:11:00.447487 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:00.447214    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:11:00.466625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:00.466577    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln" podStartSLOduration=1.88307365 podStartE2EDuration="4.46656566s" totalImagesPullingTime="2.58349201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:11:00.464726106 +0000 UTC m=+329.056239430" watchObservedRunningTime="2026-09-11 21:11:00.46656566 +0000 UTC m=+329.058079017"
Sep 11 21:11:01.453061 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:01.453024    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj" event={"ID":"1b6d7897-52e6-43b9-9494-f8363b2dd88e","Type":"ContainerStarted","Data":"29523892b26450de3807d53b1dcdf5d79ab95af1a7998cf7aaf76181d2c86631"}
Sep 11 21:11:01.453438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:01.453085    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:11:01.474839 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:01.474780    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj" podStartSLOduration=2.9600212040000002 podStartE2EDuration="5.474760428s" totalImagesPullingTime="2.514739224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:11:01.473784359 +0000 UTC m=+330.065297682" watchObservedRunningTime="2026-09-11 21:11:01.474760428 +0000 UTC m=+330.066273777"
Sep 11 21:11:02.863366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.863322    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"]
Sep 11 21:11:02.867988 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.867963    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.892016 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.891987    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"]
Sep 11 21:11:02.947682 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947626    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a51c590-35f7-4e54-882c-8127c51eba43-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.947682 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947684    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.947863 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947759    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.947863 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947796    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.947863 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947847    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a51c590-35f7-4e54-882c-8127c51eba43-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.948002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947888    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd5qq\" (UniqueName: \"kubernetes.io/projected/5a51c590-35f7-4e54-882c-8127c51eba43-kube-api-access-bd5qq\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:02.948002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:02.947912    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a51c590-35f7-4e54-882c-8127c51eba43-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.048915 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.048889    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a51c590-35f7-4e54-882c-8127c51eba43-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.048922    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a51c590-35f7-4e54-882c-8127c51eba43-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.048940    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.048971    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.049004    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049240 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.049048    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a51c590-35f7-4e54-882c-8127c51eba43-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049240 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.049086    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd5qq\" (UniqueName: \"kubernetes.io/projected/5a51c590-35f7-4e54-882c-8127c51eba43-kube-api-access-bd5qq\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.049900 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.049871    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5a51c590-35f7-4e54-882c-8127c51eba43-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.051269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.051246    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.051342 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.051276    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a51c590-35f7-4e54-882c-8127c51eba43-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.051386 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.051357    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.051450 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.051419    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5a51c590-35f7-4e54-882c-8127c51eba43-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.058002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.057979    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a51c590-35f7-4e54-882c-8127c51eba43-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.059046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.059021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd5qq\" (UniqueName: \"kubernetes.io/projected/5a51c590-35f7-4e54-882c-8127c51eba43-kube-api-access-bd5qq\") pod \"istiod-openshift-gateway-5677ccb49b-k8rzw\" (UID: \"5a51c590-35f7-4e54-882c-8127c51eba43\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.176772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.176715    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:03.461991 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.461961    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"]
Sep 11 21:11:03.464548 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:11:03.464520    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a51c590_35f7_4e54_882c_8127c51eba43.slice/crio-6cd4efd1310446ac185e6553bf9b0c20beb22b6a2782fb8aecae067fbe12e3a4 WatchSource:0}: Error finding container 6cd4efd1310446ac185e6553bf9b0c20beb22b6a2782fb8aecae067fbe12e3a4: Status 404 returned error can't find the container with id 6cd4efd1310446ac185e6553bf9b0c20beb22b6a2782fb8aecae067fbe12e3a4
Sep 11 21:11:03.468018 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.467985    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:11:03.468082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:03.468047    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:11:04.470736 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.470698    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw" event={"ID":"5a51c590-35f7-4e54-882c-8127c51eba43","Type":"ContainerStarted","Data":"bf3b8f764555245681e59d36df408ebe07ada18be1aa09f7583a75520c850101"}
Sep 11 21:11:04.471131 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.470758    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw" event={"ID":"5a51c590-35f7-4e54-882c-8127c51eba43","Type":"ContainerStarted","Data":"6cd4efd1310446ac185e6553bf9b0c20beb22b6a2782fb8aecae067fbe12e3a4"}
Sep 11 21:11:04.471131 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.470776    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:04.472388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.472369    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw"
Sep 11 21:11:04.561233 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.561176    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-k8rzw" podStartSLOduration=2.561159952 podStartE2EDuration="2.561159952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:11:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:11:04.558815432 +0000 UTC m=+333.150328756" watchObservedRunningTime="2026-09-11 21:11:04.561159952 +0000 UTC m=+333.152673276"
Sep 11 21:11:04.667752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.667722    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"]
Sep 11 21:11:04.667955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.667932    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" podUID="baf4f9f1-1126-4781-b914-19302171fa6c" containerName="discovery" containerID="cri-o://1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd" gracePeriod=30
Sep 11 21:11:04.915384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.915361    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:11:04.966500 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966473    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-istio-token\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.966627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966531    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-cacerts\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.966627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966555    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4f9f1-1126-4781-b914-19302171fa6c-local-certs\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.966627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966603    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-dns-cert\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.966814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966631    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lszq9\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-kube-api-access-lszq9\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.966814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966685    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-ca-configmap\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.966814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.966715    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-kubeconfig\") pod \"baf4f9f1-1126-4781-b914-19302171fa6c\" (UID: \"baf4f9f1-1126-4781-b914-19302171fa6c\") "
Sep 11 21:11:04.967211 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.967168    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:11:04.968958 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.968931    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-cacerts" (OuterVolumeSpecName: "cacerts") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:11:04.969055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.968966    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4f9f1-1126-4781-b914-19302171fa6c-local-certs" (OuterVolumeSpecName: "local-certs") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:11:04.969055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.969015    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:11:04.969165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.969059    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-istio-token" (OuterVolumeSpecName: "istio-token") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:11:04.969318 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.969299    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-kube-api-access-lszq9" (OuterVolumeSpecName: "kube-api-access-lszq9") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "kube-api-access-lszq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:11:04.969457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:04.969429    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "baf4f9f1-1126-4781-b914-19302171fa6c" (UID: "baf4f9f1-1126-4781-b914-19302171fa6c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:11:05.067586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067560    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-istio-token\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.067586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067584    2585 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-cacerts\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.067776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067593    2585 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/baf4f9f1-1126-4781-b914-19302171fa6c-local-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.067776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067603    2585 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-dns-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.067776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067612    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lszq9\" (UniqueName: \"kubernetes.io/projected/baf4f9f1-1126-4781-b914-19302171fa6c-kube-api-access-lszq9\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.067776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067621    2585 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/baf4f9f1-1126-4781-b914-19302171fa6c-istio-csr-ca-configmap\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.067776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.067629    2585 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/baf4f9f1-1126-4781-b914-19302171fa6c-istio-kubeconfig\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:11:05.476863 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.476794    2585 generic.go:356] "Generic (PLEG): container finished" podID="baf4f9f1-1126-4781-b914-19302171fa6c" containerID="1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd" exitCode=0
Sep 11 21:11:05.476863 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.476839    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"
Sep 11 21:11:05.477320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.476886    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" event={"ID":"baf4f9f1-1126-4781-b914-19302171fa6c","Type":"ContainerDied","Data":"1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd"}
Sep 11 21:11:05.477320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.476949    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx" event={"ID":"baf4f9f1-1126-4781-b914-19302171fa6c","Type":"ContainerDied","Data":"775afe5cc14f2dd4763cee9050399d3ea4d7581865e30b83bdd0126574afb6ea"}
Sep 11 21:11:05.477320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.476984    2585 scope.go:117] "RemoveContainer" containerID="1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd"
Sep 11 21:11:05.486396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.486379    2585 scope.go:117] "RemoveContainer" containerID="1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd"
Sep 11 21:11:05.486704 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:11:05.486684    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd\": container with ID starting with 1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd not found: ID does not exist" containerID="1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd"
Sep 11 21:11:05.486750 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.486714    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd"} err="failed to get container status \"1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd\": rpc error: code = NotFound desc = could not find container \"1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd\": container with ID starting with 1ffbcc168173722ea16c0408009ee69996ba1d874916b79dba739cd9338440bd not found: ID does not exist"
Sep 11 21:11:05.517874 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.517851    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"]
Sep 11 21:11:05.529049 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.529029    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-8v4sx"]
Sep 11 21:11:05.793719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.793690    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:05.888207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.888167    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baf4f9f1-1126-4781-b914-19302171fa6c" path="/var/lib/kubelet/pods/baf4f9f1-1126-4781-b914-19302171fa6c/volumes"
Sep 11 21:11:05.908969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.908932    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:05.915866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.915845    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"]
Sep 11 21:11:05.916144 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.916133    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf4f9f1-1126-4781-b914-19302171fa6c" containerName="discovery"
Sep 11 21:11:05.916185 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.916147    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf4f9f1-1126-4781-b914-19302171fa6c" containerName="discovery"
Sep 11 21:11:05.916216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.916200    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf4f9f1-1126-4781-b914-19302171fa6c" containerName="discovery"
Sep 11 21:11:05.920158 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.920144    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:05.926334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.926316    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-mdjmt\""
Sep 11 21:11:05.926784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.926767    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 21:11:05.943240 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.943217    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"]
Sep 11 21:11:05.973715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.973671    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cefc0a66-49d8-46b0-9906-dc95d456dbb5-cert\") pod \"kserve-controller-manager-d6f4b65b8-pp47s\" (UID: \"cefc0a66-49d8-46b0-9906-dc95d456dbb5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:05.973846 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:05.973749    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxjzm\" (UniqueName: \"kubernetes.io/projected/cefc0a66-49d8-46b0-9906-dc95d456dbb5-kube-api-access-fxjzm\") pod \"kserve-controller-manager-d6f4b65b8-pp47s\" (UID: \"cefc0a66-49d8-46b0-9906-dc95d456dbb5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:06.038072 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.038043    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:06.074614 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.074552    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cefc0a66-49d8-46b0-9906-dc95d456dbb5-cert\") pod \"kserve-controller-manager-d6f4b65b8-pp47s\" (UID: \"cefc0a66-49d8-46b0-9906-dc95d456dbb5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:06.074614 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.074608    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxjzm\" (UniqueName: \"kubernetes.io/projected/cefc0a66-49d8-46b0-9906-dc95d456dbb5-kube-api-access-fxjzm\") pod \"kserve-controller-manager-d6f4b65b8-pp47s\" (UID: \"cefc0a66-49d8-46b0-9906-dc95d456dbb5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:06.076985 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.076964    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cefc0a66-49d8-46b0-9906-dc95d456dbb5-cert\") pod \"kserve-controller-manager-d6f4b65b8-pp47s\" (UID: \"cefc0a66-49d8-46b0-9906-dc95d456dbb5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:06.084719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.084700    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxjzm\" (UniqueName: \"kubernetes.io/projected/cefc0a66-49d8-46b0-9906-dc95d456dbb5-kube-api-access-fxjzm\") pod \"kserve-controller-manager-d6f4b65b8-pp47s\" (UID: \"cefc0a66-49d8-46b0-9906-dc95d456dbb5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:06.168861 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.168837    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:06.229344 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.229326    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:06.348493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.348425    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:06.514477 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:06.514454    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"]
Sep 11 21:11:06.515816 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:11:06.515781    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefc0a66_49d8_46b0_9906_dc95d456dbb5.slice/crio-22c14c470d55f1fe423b018ead4232b90b1688561227547ffb0db6c174f240b2 WatchSource:0}: Error finding container 22c14c470d55f1fe423b018ead4232b90b1688561227547ffb0db6c174f240b2: Status 404 returned error can't find the container with id 22c14c470d55f1fe423b018ead4232b90b1688561227547ffb0db6c174f240b2
Sep 11 21:11:07.134995 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:07.134949    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:07.231463 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:07.231426    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:07.490747 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:07.490600    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s" event={"ID":"cefc0a66-49d8-46b0-9906-dc95d456dbb5","Type":"ContainerStarted","Data":"22c14c470d55f1fe423b018ead4232b90b1688561227547ffb0db6c174f240b2"}
Sep 11 21:11:09.502390 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:09.502355    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s" event={"ID":"cefc0a66-49d8-46b0-9906-dc95d456dbb5","Type":"ContainerStarted","Data":"cd665b27a1a49deaaf78c3898f7c71f0a63ddb1557b991a38293f5a51558dae6"}
Sep 11 21:11:09.502746 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:09.502429    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:09.538089 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:09.538047    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s" podStartSLOduration=2.489304277 podStartE2EDuration="4.538035442s" totalImagesPullingTime="2.048731165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:11:09.536337829 +0000 UTC m=+338.127851151" watchObservedRunningTime="2026-09-11 21:11:09.538035442 +0000 UTC m=+338.129548771"
Sep 11 21:11:11.455295 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:11.455262    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-z4bln"
Sep 11 21:11:12.462405 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:12.462366    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5kgnj"
Sep 11 21:11:40.512967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:40.512936    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pp47s"
Sep 11 21:11:43.916252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:43.916182    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:43.995120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:43.995083    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:57.367703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:57.367660    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:11:57.471590 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:11:57.471555    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:01.491231 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.491196    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"]
Sep 11 21:12:01.494703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.494685    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.496974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.496944    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:12:01.497660 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.497629    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-98x5r\""
Sep 11 21:12:01.497719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.497680    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:12:01.503267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.503245    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"]
Sep 11 21:12:01.526561 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.526534    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.526718 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.526584    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.526718 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.526633    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6s8z\" (UniqueName: \"kubernetes.io/projected/f1fd4e65-7baf-405a-8469-0ee2acfae358-kube-api-access-v6s8z\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.592761 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.592730    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"]
Sep 11 21:12:01.596073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.596055    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.604730 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.604705    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"]
Sep 11 21:12:01.627882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.627860    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.627978 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.627912    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.628022 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.627979    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.628022 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.628010    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r79jm\" (UniqueName: \"kubernetes.io/projected/391d8f6e-f31d-491f-90d1-50ea47dafbac-kube-api-access-r79jm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.628166 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.628035    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6s8z\" (UniqueName: \"kubernetes.io/projected/f1fd4e65-7baf-405a-8469-0ee2acfae358-kube-api-access-v6s8z\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.628166 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.628067    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.628233 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.628198    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.628280 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.628265    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.636230 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.636203    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6s8z\" (UniqueName: \"kubernetes.io/projected/f1fd4e65-7baf-405a-8469-0ee2acfae358-kube-api-access-v6s8z\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.695720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.695695    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"]
Sep 11 21:12:01.699137 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.699122    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.708139 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.708119    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"]
Sep 11 21:12:01.728686 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.728658    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r79jm\" (UniqueName: \"kubernetes.io/projected/391d8f6e-f31d-491f-90d1-50ea47dafbac-kube-api-access-r79jm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.728773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.728712    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.728773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.728742    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.728773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.728768    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.728884 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.728810    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.728922 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.728892    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2xx6\" (UniqueName: \"kubernetes.io/projected/940ec492-21a0-4a06-bce2-14efef64ccd2-kube-api-access-m2xx6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.729077 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.729063    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.729112 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.729092    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.736399 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.736378    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r79jm\" (UniqueName: \"kubernetes.io/projected/391d8f6e-f31d-491f-90d1-50ea47dafbac-kube-api-access-r79jm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.794306 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.794281    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"]
Sep 11 21:12:01.797732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.797718    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.804570 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.804550    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:01.806942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.806919    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"]
Sep 11 21:12:01.829816 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.829794    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.829925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.829824    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.829925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.829848    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2xx6\" (UniqueName: \"kubernetes.io/projected/940ec492-21a0-4a06-bce2-14efef64ccd2-kube-api-access-m2xx6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.829925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.829877    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sggsw\" (UniqueName: \"kubernetes.io/projected/dc7617a2-1e83-42f2-be86-0e24838b2216-kube-api-access-sggsw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.829925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.829923    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.830163 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.829938    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.830219 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.830158    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.830273 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.830240    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.838936 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.838909    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2xx6\" (UniqueName: \"kubernetes.io/projected/940ec492-21a0-4a06-bce2-14efef64ccd2-kube-api-access-m2xx6\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:01.905737 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.905714    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:01.930980 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.930956    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.931089 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.930986    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.931089 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.931050    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sggsw\" (UniqueName: \"kubernetes.io/projected/dc7617a2-1e83-42f2-be86-0e24838b2216-kube-api-access-sggsw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.931445 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.931425    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.931501 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.931428    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:01.939694 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:01.939671    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sggsw\" (UniqueName: \"kubernetes.io/projected/dc7617a2-1e83-42f2-be86-0e24838b2216-kube-api-access-sggsw\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:02.008688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.008657    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:02.081846 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.081818    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"]
Sep 11 21:12:02.083968 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:12:02.083939    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1fd4e65_7baf_405a_8469_0ee2acfae358.slice/crio-261821e38654a624aac7dd4b7d218caebf63b4339ba11df9a91abf872e1f8fc4 WatchSource:0}: Error finding container 261821e38654a624aac7dd4b7d218caebf63b4339ba11df9a91abf872e1f8fc4: Status 404 returned error can't find the container with id 261821e38654a624aac7dd4b7d218caebf63b4339ba11df9a91abf872e1f8fc4
Sep 11 21:12:02.106473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.106450    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:02.181206 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.181175    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"]
Sep 11 21:12:02.182946 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:12:02.182909    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391d8f6e_f31d_491f_90d1_50ea47dafbac.slice/crio-f6e760de4db442141b931bb9ddb7c85785e3f1b3a75d2ec22d8e70cbd7708abc WatchSource:0}: Error finding container f6e760de4db442141b931bb9ddb7c85785e3f1b3a75d2ec22d8e70cbd7708abc: Status 404 returned error can't find the container with id f6e760de4db442141b931bb9ddb7c85785e3f1b3a75d2ec22d8e70cbd7708abc
Sep 11 21:12:02.279379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.279355    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"]
Sep 11 21:12:02.281019 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:12:02.280996    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940ec492_21a0_4a06_bce2_14efef64ccd2.slice/crio-9666af9c57e823c5d52d5638df5870f0f2415fd78b7a7a9a45d43ef93105d005 WatchSource:0}: Error finding container 9666af9c57e823c5d52d5638df5870f0f2415fd78b7a7a9a45d43ef93105d005: Status 404 returned error can't find the container with id 9666af9c57e823c5d52d5638df5870f0f2415fd78b7a7a9a45d43ef93105d005
Sep 11 21:12:02.380826 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.380801    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"]
Sep 11 21:12:02.382038 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:12:02.382015    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7617a2_1e83_42f2_be86_0e24838b2216.slice/crio-fa4011426bfccc12334833c69f183368417227895063c799475ee2e5413b8ece WatchSource:0}: Error finding container fa4011426bfccc12334833c69f183368417227895063c799475ee2e5413b8ece: Status 404 returned error can't find the container with id fa4011426bfccc12334833c69f183368417227895063c799475ee2e5413b8ece
Sep 11 21:12:02.767757 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.767686    2585 generic.go:356] "Generic (PLEG): container finished" podID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerID="527d64dd2c5ce9de95fee34e125142bd05b4e206309f773c7259fb344cc2be30" exitCode=0
Sep 11 21:12:02.768262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.767777    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp" event={"ID":"f1fd4e65-7baf-405a-8469-0ee2acfae358","Type":"ContainerDied","Data":"527d64dd2c5ce9de95fee34e125142bd05b4e206309f773c7259fb344cc2be30"}
Sep 11 21:12:02.768262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.767846    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp" event={"ID":"f1fd4e65-7baf-405a-8469-0ee2acfae358","Type":"ContainerStarted","Data":"261821e38654a624aac7dd4b7d218caebf63b4339ba11df9a91abf872e1f8fc4"}
Sep 11 21:12:02.769461 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.769440    2585 generic.go:356] "Generic (PLEG): container finished" podID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerID="ec4d81b24412e0b54fd5fbdb1c52c9ed96a5ef5aa589d1c2f352a3c63e7413c5" exitCode=0
Sep 11 21:12:02.769532 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.769476    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4" event={"ID":"dc7617a2-1e83-42f2-be86-0e24838b2216","Type":"ContainerDied","Data":"ec4d81b24412e0b54fd5fbdb1c52c9ed96a5ef5aa589d1c2f352a3c63e7413c5"}
Sep 11 21:12:02.769532 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.769519    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4" event={"ID":"dc7617a2-1e83-42f2-be86-0e24838b2216","Type":"ContainerStarted","Data":"fa4011426bfccc12334833c69f183368417227895063c799475ee2e5413b8ece"}
Sep 11 21:12:02.771229 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.771200    2585 generic.go:356] "Generic (PLEG): container finished" podID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerID="2ddec533d59212f7d5d909b37e4138c6ec34b833d861e8f79d288c200b42956d" exitCode=0
Sep 11 21:12:02.771330 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.771309    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg" event={"ID":"391d8f6e-f31d-491f-90d1-50ea47dafbac","Type":"ContainerDied","Data":"2ddec533d59212f7d5d909b37e4138c6ec34b833d861e8f79d288c200b42956d"}
Sep 11 21:12:02.771397 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.771346    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg" event={"ID":"391d8f6e-f31d-491f-90d1-50ea47dafbac","Type":"ContainerStarted","Data":"f6e760de4db442141b931bb9ddb7c85785e3f1b3a75d2ec22d8e70cbd7708abc"}
Sep 11 21:12:02.772941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.772920    2585 generic.go:356] "Generic (PLEG): container finished" podID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerID="6ae3e3c77388ac04ec4e2a5d924e147c309a4a59384b35570ad0fa43a78e8a3e" exitCode=0
Sep 11 21:12:02.773042 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.772968    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7" event={"ID":"940ec492-21a0-4a06-bce2-14efef64ccd2","Type":"ContainerDied","Data":"6ae3e3c77388ac04ec4e2a5d924e147c309a4a59384b35570ad0fa43a78e8a3e"}
Sep 11 21:12:02.773042 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:02.772996    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7" event={"ID":"940ec492-21a0-4a06-bce2-14efef64ccd2","Type":"ContainerStarted","Data":"9666af9c57e823c5d52d5638df5870f0f2415fd78b7a7a9a45d43ef93105d005"}
Sep 11 21:12:03.779869 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:03.779840    2585 generic.go:356] "Generic (PLEG): container finished" podID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerID="4d64b0aa24610dcc37a267042d7aecc71915d16498c7c6f4d824f0cd17fe02ff" exitCode=0
Sep 11 21:12:03.780183 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:03.779970    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp" event={"ID":"f1fd4e65-7baf-405a-8469-0ee2acfae358","Type":"ContainerDied","Data":"4d64b0aa24610dcc37a267042d7aecc71915d16498c7c6f4d824f0cd17fe02ff"}
Sep 11 21:12:03.781885 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:03.781865    2585 generic.go:356] "Generic (PLEG): container finished" podID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerID="2605e8b3b951cb054956cf9fe45077c9823f1bf6484a0c9dcdd571a475e3f517" exitCode=0
Sep 11 21:12:03.781982 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:03.781911    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg" event={"ID":"391d8f6e-f31d-491f-90d1-50ea47dafbac","Type":"ContainerDied","Data":"2605e8b3b951cb054956cf9fe45077c9823f1bf6484a0c9dcdd571a475e3f517"}
Sep 11 21:12:04.791850 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.791812    2585 generic.go:356] "Generic (PLEG): container finished" podID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerID="5378570d05c90a0cb5cbfd043319b8058e2cea4b54a43fdcb8c72bb360c32978" exitCode=0
Sep 11 21:12:04.792301 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.791895    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7" event={"ID":"940ec492-21a0-4a06-bce2-14efef64ccd2","Type":"ContainerDied","Data":"5378570d05c90a0cb5cbfd043319b8058e2cea4b54a43fdcb8c72bb360c32978"}
Sep 11 21:12:04.794220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.794199    2585 generic.go:356] "Generic (PLEG): container finished" podID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerID="7aeb20cda306d5dc616a29439fedb629a9fec9dc507eea1be1cca87a77ce7104" exitCode=0
Sep 11 21:12:04.794310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.794285    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp" event={"ID":"f1fd4e65-7baf-405a-8469-0ee2acfae358","Type":"ContainerDied","Data":"7aeb20cda306d5dc616a29439fedb629a9fec9dc507eea1be1cca87a77ce7104"}
Sep 11 21:12:04.795974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.795952    2585 generic.go:356] "Generic (PLEG): container finished" podID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerID="4e57ad68cf5d70c71f71780ffcfd181064672f6d7872dd711c6fea68427ce239" exitCode=0
Sep 11 21:12:04.796063 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.796034    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4" event={"ID":"dc7617a2-1e83-42f2-be86-0e24838b2216","Type":"ContainerDied","Data":"4e57ad68cf5d70c71f71780ffcfd181064672f6d7872dd711c6fea68427ce239"}
Sep 11 21:12:04.798403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.798381    2585 generic.go:356] "Generic (PLEG): container finished" podID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerID="a03cc91e6e70b3e46543c767597fac6ef3a80314e7bb7df43f5edb8f0e1de2ed" exitCode=0
Sep 11 21:12:04.798484 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:04.798422    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg" event={"ID":"391d8f6e-f31d-491f-90d1-50ea47dafbac","Type":"ContainerDied","Data":"a03cc91e6e70b3e46543c767597fac6ef3a80314e7bb7df43f5edb8f0e1de2ed"}
Sep 11 21:12:05.806932 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:05.806898    2585 generic.go:356] "Generic (PLEG): container finished" podID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerID="4ff6fdcf90d9fe757ff3289efb9cb6eda36bea726e3ae9dc4307db3cbfff2841" exitCode=0
Sep 11 21:12:05.807553 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:05.806971    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7" event={"ID":"940ec492-21a0-4a06-bce2-14efef64ccd2","Type":"ContainerDied","Data":"4ff6fdcf90d9fe757ff3289efb9cb6eda36bea726e3ae9dc4307db3cbfff2841"}
Sep 11 21:12:05.809210 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:05.809187    2585 generic.go:356] "Generic (PLEG): container finished" podID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerID="a9ecf53c9e707f75c2a40d71c62ac94cad0035518e4b678e569c6030d1c5dcb1" exitCode=0
Sep 11 21:12:05.809333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:05.809273    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4" event={"ID":"dc7617a2-1e83-42f2-be86-0e24838b2216","Type":"ContainerDied","Data":"a9ecf53c9e707f75c2a40d71c62ac94cad0035518e4b678e569c6030d1c5dcb1"}
Sep 11 21:12:05.956891 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:05.956869    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:05.959720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:05.959702    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:06.065114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065027    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r79jm\" (UniqueName: \"kubernetes.io/projected/391d8f6e-f31d-491f-90d1-50ea47dafbac-kube-api-access-r79jm\") pod \"391d8f6e-f31d-491f-90d1-50ea47dafbac\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") "
Sep 11 21:12:06.065114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065081    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-bundle\") pod \"391d8f6e-f31d-491f-90d1-50ea47dafbac\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") "
Sep 11 21:12:06.065114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065105    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-util\") pod \"f1fd4e65-7baf-405a-8469-0ee2acfae358\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") "
Sep 11 21:12:06.065389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065121    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-util\") pod \"391d8f6e-f31d-491f-90d1-50ea47dafbac\" (UID: \"391d8f6e-f31d-491f-90d1-50ea47dafbac\") "
Sep 11 21:12:06.065389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065164    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-bundle\") pod \"f1fd4e65-7baf-405a-8469-0ee2acfae358\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") "
Sep 11 21:12:06.065389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065191    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6s8z\" (UniqueName: \"kubernetes.io/projected/f1fd4e65-7baf-405a-8469-0ee2acfae358-kube-api-access-v6s8z\") pod \"f1fd4e65-7baf-405a-8469-0ee2acfae358\" (UID: \"f1fd4e65-7baf-405a-8469-0ee2acfae358\") "
Sep 11 21:12:06.065755 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.065728    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-bundle" (OuterVolumeSpecName: "bundle") pod "391d8f6e-f31d-491f-90d1-50ea47dafbac" (UID: "391d8f6e-f31d-491f-90d1-50ea47dafbac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:06.066038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.066009    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-bundle" (OuterVolumeSpecName: "bundle") pod "f1fd4e65-7baf-405a-8469-0ee2acfae358" (UID: "f1fd4e65-7baf-405a-8469-0ee2acfae358"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:06.067342 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.067323    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391d8f6e-f31d-491f-90d1-50ea47dafbac-kube-api-access-r79jm" (OuterVolumeSpecName: "kube-api-access-r79jm") pod "391d8f6e-f31d-491f-90d1-50ea47dafbac" (UID: "391d8f6e-f31d-491f-90d1-50ea47dafbac"). InnerVolumeSpecName "kube-api-access-r79jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:06.067698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.067633    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1fd4e65-7baf-405a-8469-0ee2acfae358-kube-api-access-v6s8z" (OuterVolumeSpecName: "kube-api-access-v6s8z") pod "f1fd4e65-7baf-405a-8469-0ee2acfae358" (UID: "f1fd4e65-7baf-405a-8469-0ee2acfae358"). InnerVolumeSpecName "kube-api-access-v6s8z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:06.071400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.071380    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-util" (OuterVolumeSpecName: "util") pod "391d8f6e-f31d-491f-90d1-50ea47dafbac" (UID: "391d8f6e-f31d-491f-90d1-50ea47dafbac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:06.073332 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.073308    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-util" (OuterVolumeSpecName: "util") pod "f1fd4e65-7baf-405a-8469-0ee2acfae358" (UID: "f1fd4e65-7baf-405a-8469-0ee2acfae358"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:06.166835 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.166802    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6s8z\" (UniqueName: \"kubernetes.io/projected/f1fd4e65-7baf-405a-8469-0ee2acfae358-kube-api-access-v6s8z\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:06.166835 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.166830    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r79jm\" (UniqueName: \"kubernetes.io/projected/391d8f6e-f31d-491f-90d1-50ea47dafbac-kube-api-access-r79jm\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:06.166835 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.166839    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:06.167047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.166848    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:06.167047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.166855    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/391d8f6e-f31d-491f-90d1-50ea47dafbac-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:06.167047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.166862    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f1fd4e65-7baf-405a-8469-0ee2acfae358-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:06.815945 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.815913    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp"
Sep 11 21:12:06.815945 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.815925    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847armkgp" event={"ID":"f1fd4e65-7baf-405a-8469-0ee2acfae358","Type":"ContainerDied","Data":"261821e38654a624aac7dd4b7d218caebf63b4339ba11df9a91abf872e1f8fc4"}
Sep 11 21:12:06.816394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.815975    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="261821e38654a624aac7dd4b7d218caebf63b4339ba11df9a91abf872e1f8fc4"
Sep 11 21:12:06.817967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.817947    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg"
Sep 11 21:12:06.818088 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.817971    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxs2zg" event={"ID":"391d8f6e-f31d-491f-90d1-50ea47dafbac","Type":"ContainerDied","Data":"f6e760de4db442141b931bb9ddb7c85785e3f1b3a75d2ec22d8e70cbd7708abc"}
Sep 11 21:12:06.818088 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.818029    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6e760de4db442141b931bb9ddb7c85785e3f1b3a75d2ec22d8e70cbd7708abc"
Sep 11 21:12:06.966892 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.966867    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:06.968880 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:06.968864    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:07.073098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073027    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-bundle\") pod \"dc7617a2-1e83-42f2-be86-0e24838b2216\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") "
Sep 11 21:12:07.073098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073057    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-util\") pod \"dc7617a2-1e83-42f2-be86-0e24838b2216\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") "
Sep 11 21:12:07.073098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073079    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-util\") pod \"940ec492-21a0-4a06-bce2-14efef64ccd2\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") "
Sep 11 21:12:07.073354 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073106    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sggsw\" (UniqueName: \"kubernetes.io/projected/dc7617a2-1e83-42f2-be86-0e24838b2216-kube-api-access-sggsw\") pod \"dc7617a2-1e83-42f2-be86-0e24838b2216\" (UID: \"dc7617a2-1e83-42f2-be86-0e24838b2216\") "
Sep 11 21:12:07.073354 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073124    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-bundle\") pod \"940ec492-21a0-4a06-bce2-14efef64ccd2\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") "
Sep 11 21:12:07.073354 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073180    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2xx6\" (UniqueName: \"kubernetes.io/projected/940ec492-21a0-4a06-bce2-14efef64ccd2-kube-api-access-m2xx6\") pod \"940ec492-21a0-4a06-bce2-14efef64ccd2\" (UID: \"940ec492-21a0-4a06-bce2-14efef64ccd2\") "
Sep 11 21:12:07.073673 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073625    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-bundle" (OuterVolumeSpecName: "bundle") pod "dc7617a2-1e83-42f2-be86-0e24838b2216" (UID: "dc7617a2-1e83-42f2-be86-0e24838b2216"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:07.073815 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.073764    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-bundle" (OuterVolumeSpecName: "bundle") pod "940ec492-21a0-4a06-bce2-14efef64ccd2" (UID: "940ec492-21a0-4a06-bce2-14efef64ccd2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:07.075214 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.075175    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7617a2-1e83-42f2-be86-0e24838b2216-kube-api-access-sggsw" (OuterVolumeSpecName: "kube-api-access-sggsw") pod "dc7617a2-1e83-42f2-be86-0e24838b2216" (UID: "dc7617a2-1e83-42f2-be86-0e24838b2216"). InnerVolumeSpecName "kube-api-access-sggsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:07.075598 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.075576    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940ec492-21a0-4a06-bce2-14efef64ccd2-kube-api-access-m2xx6" (OuterVolumeSpecName: "kube-api-access-m2xx6") pod "940ec492-21a0-4a06-bce2-14efef64ccd2" (UID: "940ec492-21a0-4a06-bce2-14efef64ccd2"). InnerVolumeSpecName "kube-api-access-m2xx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:07.079082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.079047    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-util" (OuterVolumeSpecName: "util") pod "940ec492-21a0-4a06-bce2-14efef64ccd2" (UID: "940ec492-21a0-4a06-bce2-14efef64ccd2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:07.079537 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.079518    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-util" (OuterVolumeSpecName: "util") pod "dc7617a2-1e83-42f2-be86-0e24838b2216" (UID: "dc7617a2-1e83-42f2-be86-0e24838b2216"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:12:07.174436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.174407    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2xx6\" (UniqueName: \"kubernetes.io/projected/940ec492-21a0-4a06-bce2-14efef64ccd2-kube-api-access-m2xx6\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:07.174436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.174432    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:07.174583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.174446    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dc7617a2-1e83-42f2-be86-0e24838b2216-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:07.174583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.174457    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-util\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:07.174583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.174469    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sggsw\" (UniqueName: \"kubernetes.io/projected/dc7617a2-1e83-42f2-be86-0e24838b2216-kube-api-access-sggsw\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:07.174583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.174480    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/940ec492-21a0-4a06-bce2-14efef64ccd2-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:07.824988 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.824959    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4"
Sep 11 21:12:07.825426 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.824995    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vp2c4" event={"ID":"dc7617a2-1e83-42f2-be86-0e24838b2216","Type":"ContainerDied","Data":"fa4011426bfccc12334833c69f183368417227895063c799475ee2e5413b8ece"}
Sep 11 21:12:07.825426 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.825042    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa4011426bfccc12334833c69f183368417227895063c799475ee2e5413b8ece"
Sep 11 21:12:07.826938 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.826918    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7"
Sep 11 21:12:07.826938 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.826936    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vhzq7" event={"ID":"940ec492-21a0-4a06-bce2-14efef64ccd2","Type":"ContainerDied","Data":"9666af9c57e823c5d52d5638df5870f0f2415fd78b7a7a9a45d43ef93105d005"}
Sep 11 21:12:07.827140 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:07.826967    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9666af9c57e823c5d52d5638df5870f0f2415fd78b7a7a9a45d43ef93105d005"
Sep 11 21:12:09.181035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:09.180998    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:09.981375 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:09.981344    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:12.086391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.086358    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:12.452921 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.452813    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2m7hm"]
Sep 11 21:12:12.453357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453335    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="pull"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453360    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="pull"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453367    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="pull"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453374    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="pull"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453382    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="util"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453388    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="util"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453396    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="util"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453401    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="util"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453408    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="extract"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453413    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="extract"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453422    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="pull"
Sep 11 21:12:12.453436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453427    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="pull"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453448    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="util"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453453    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="util"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453460    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="pull"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453465    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="pull"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453471    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453476    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453484    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453489    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453495    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453500    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453507    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="util"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453512    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="util"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453573    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7617a2-1e83-42f2-be86-0e24838b2216" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453583    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1fd4e65-7baf-405a-8469-0ee2acfae358" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453590    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="391d8f6e-f31d-491f-90d1-50ea47dafbac" containerName="extract"
Sep 11 21:12:12.453794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.453595    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="940ec492-21a0-4a06-bce2-14efef64ccd2" containerName="extract"
Sep 11 21:12:12.457846 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.457826    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:12.460136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.460098    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 21:12:12.460254 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.460156    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 21:12:12.460322 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.460248    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-v7m62\""
Sep 11 21:12:12.473197 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.473172    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2m7hm"]
Sep 11 21:12:12.513416 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.513386    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhcg\" (UniqueName: \"kubernetes.io/projected/5e4b7a91-085b-4400-a765-6180d2b98318-kube-api-access-jvhcg\") pod \"authorino-operator-76b478bd78-2m7hm\" (UID: \"5e4b7a91-085b-4400-a765-6180d2b98318\") " pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:12.613901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.613874    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhcg\" (UniqueName: \"kubernetes.io/projected/5e4b7a91-085b-4400-a765-6180d2b98318-kube-api-access-jvhcg\") pod \"authorino-operator-76b478bd78-2m7hm\" (UID: \"5e4b7a91-085b-4400-a765-6180d2b98318\") " pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:12.625491 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.625462    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhcg\" (UniqueName: \"kubernetes.io/projected/5e4b7a91-085b-4400-a765-6180d2b98318-kube-api-access-jvhcg\") pod \"authorino-operator-76b478bd78-2m7hm\" (UID: \"5e4b7a91-085b-4400-a765-6180d2b98318\") " pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:12.768937 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:12.768880    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:13.006209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:13.006177    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:13.045900 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:13.045877    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-2m7hm"]
Sep 11 21:12:13.047860 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:12:13.047835    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e4b7a91_085b_4400_a765_6180d2b98318.slice/crio-4ee0f756fe592fb99b81aae066c0d53539b4a4c0a352f0ec9e5f6ffb82a063b9 WatchSource:0}: Error finding container 4ee0f756fe592fb99b81aae066c0d53539b4a4c0a352f0ec9e5f6ffb82a063b9: Status 404 returned error can't find the container with id 4ee0f756fe592fb99b81aae066c0d53539b4a4c0a352f0ec9e5f6ffb82a063b9
Sep 11 21:12:13.239697 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:13.239619    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:13.391313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:13.391242    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:13.863979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:13.863941    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm" event={"ID":"5e4b7a91-085b-4400-a765-6180d2b98318","Type":"ContainerStarted","Data":"4ee0f756fe592fb99b81aae066c0d53539b4a4c0a352f0ec9e5f6ffb82a063b9"}
Sep 11 21:12:13.995251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:13.995214    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:15.661033 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:15.660959    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:15.763209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:15.763171    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:15.876370 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:15.876335    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm" event={"ID":"5e4b7a91-085b-4400-a765-6180d2b98318","Type":"ContainerStarted","Data":"5d49caf592c0d4e2155d3133763eb2b051a1118ca05ddc07a352cc518b2e2bbf"}
Sep 11 21:12:15.876534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:15.876400    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:15.896710 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:15.896668    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm" podStartSLOduration=1.548639015 podStartE2EDuration="3.896655806s" totalImagesPullingTime="2.348016791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:15.895845062 +0000 UTC m=+404.487358386" watchObservedRunningTime="2026-09-11 21:12:15.896655806 +0000 UTC m=+404.488169123"
Sep 11 21:12:17.409243 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:17.409212    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:17.639938 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:17.639901    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:19.084630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.084597    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"]
Sep 11 21:12:19.088152 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.088135    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:19.090669 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.090634    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 21:12:19.090730 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.090634    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jdm9b\""
Sep 11 21:12:19.101862 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.101837    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"]
Sep 11 21:12:19.169530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.169500    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxrqw\" (UniqueName: \"kubernetes.io/projected/b962a3ab-bc18-4375-90a9-8b6b858cba9b-kube-api-access-bxrqw\") pod \"dns-operator-controller-manager-7b84cd7c9c-c2s9b\" (UID: \"b962a3ab-bc18-4375-90a9-8b6b858cba9b\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:19.270446 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.270420    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxrqw\" (UniqueName: \"kubernetes.io/projected/b962a3ab-bc18-4375-90a9-8b6b858cba9b-kube-api-access-bxrqw\") pod \"dns-operator-controller-manager-7b84cd7c9c-c2s9b\" (UID: \"b962a3ab-bc18-4375-90a9-8b6b858cba9b\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:19.281421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.281391    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxrqw\" (UniqueName: \"kubernetes.io/projected/b962a3ab-bc18-4375-90a9-8b6b858cba9b-kube-api-access-bxrqw\") pod \"dns-operator-controller-manager-7b84cd7c9c-c2s9b\" (UID: \"b962a3ab-bc18-4375-90a9-8b6b858cba9b\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:19.398222 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.398171    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:19.582672 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.582618    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:19.676315 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.676288    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"]
Sep 11 21:12:19.676969 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:12:19.676946    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb962a3ab_bc18_4375_90a9_8b6b858cba9b.slice/crio-f35b5433e6048bdf09758fedc19bf2df68a706855eba9c0baa9ca6c3217a7eaa WatchSource:0}: Error finding container f35b5433e6048bdf09758fedc19bf2df68a706855eba9c0baa9ca6c3217a7eaa: Status 404 returned error can't find the container with id f35b5433e6048bdf09758fedc19bf2df68a706855eba9c0baa9ca6c3217a7eaa
Sep 11 21:12:19.896838 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:19.896808    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b" event={"ID":"b962a3ab-bc18-4375-90a9-8b6b858cba9b","Type":"ContainerStarted","Data":"f35b5433e6048bdf09758fedc19bf2df68a706855eba9c0baa9ca6c3217a7eaa"}
Sep 11 21:12:21.474207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:21.474156    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:21.911439 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:21.910681    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b" event={"ID":"b962a3ab-bc18-4375-90a9-8b6b858cba9b","Type":"ContainerStarted","Data":"77fd5a3905574e0074d8fd5045b187a847d1f303d54c7088638f78be4a01c3b0"}
Sep 11 21:12:21.911439 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:21.911380    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:21.934493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:21.934446    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b" podStartSLOduration=0.954162327 podStartE2EDuration="2.934430544s" totalImagesPullingTime="1.980268217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:12:21.932578507 +0000 UTC m=+410.524091829" watchObservedRunningTime="2026-09-11 21:12:21.934430544 +0000 UTC m=+410.525943866"
Sep 11 21:12:22.401274 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:22.401243    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:22.500716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:22.500679    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:22.791984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:22.791948    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:22.894653 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:22.894609    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:23.195379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:23.195305    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69546474db-rbwgw"]
Sep 11 21:12:23.531131 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:23.531040    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:23.629226 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:23.629184    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:23.733412 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:23.733378    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:24.283296 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:24.283256    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:24.585678 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:24.585572    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:26.883910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:26.883881    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-2m7hm"
Sep 11 21:12:27.186439 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:27.186348    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:27.286583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:27.286545    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:27.624118 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:27.624085    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:27.776987 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:27.776951    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:27.874577 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:27.874495    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:27.974109 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:27.974074    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:33.485657 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:33.485607    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:33.590215 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:33.590182    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:33.923887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:33.923856    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-c2s9b"
Sep 11 21:12:36.840622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:36.840579    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:36.948271 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:36.948240    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:38.219814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:38.219771    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:38.326906 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:38.326873    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:41.918527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:41.918486    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:42.000463 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:42.000434    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:42.198588 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:42.198517    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:42.272250 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:42.272215    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:46.170840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:46.170803    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:46.262699 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:46.262662    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:46.363242 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:46.363202    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:48.214570 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.214524    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69546474db-rbwgw" podUID="7de2f683-81d7-4af3-851b-fa13d97ad8b1" containerName="console" containerID="cri-o://aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae" gracePeriod=15
Sep 11 21:12:48.462813 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.462787    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:12:48.600610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600583    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-oauth-config\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.600833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600622    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-service-ca\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.600833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600667    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-config\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.600833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600718    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8w9x5\" (UniqueName: \"kubernetes.io/projected/7de2f683-81d7-4af3-851b-fa13d97ad8b1-kube-api-access-8w9x5\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.600833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600761    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-oauth-serving-cert\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.600833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600792    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-trusted-ca-bundle\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.600833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.600814    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-serving-cert\") pod \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\" (UID: \"7de2f683-81d7-4af3-851b-fa13d97ad8b1\") "
Sep 11 21:12:48.601218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.601112    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-service-ca" (OuterVolumeSpecName: "service-ca") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:12:48.601218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.601157    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-config" (OuterVolumeSpecName: "console-config") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:12:48.601329 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.601223    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:12:48.601416 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.601388    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:12:48.602907 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.602885    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:12:48.603005 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.602914    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de2f683-81d7-4af3-851b-fa13d97ad8b1-kube-api-access-8w9x5" (OuterVolumeSpecName: "kube-api-access-8w9x5") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "kube-api-access-8w9x5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:12:48.603059 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.603041    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7de2f683-81d7-4af3-851b-fa13d97ad8b1" (UID: "7de2f683-81d7-4af3-851b-fa13d97ad8b1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:12:48.702457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702416    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-trusted-ca-bundle\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.702457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702449    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-serving-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.702457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702459    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-oauth-config\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.702457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702468    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.702784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702477    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-console-config\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.702784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702485    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8w9x5\" (UniqueName: \"kubernetes.io/projected/7de2f683-81d7-4af3-851b-fa13d97ad8b1-kube-api-access-8w9x5\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:48.702784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:48.702494    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7de2f683-81d7-4af3-851b-fa13d97ad8b1-oauth-serving-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:12:49.054276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.054247    2585 generic.go:356] "Generic (PLEG): container finished" podID="7de2f683-81d7-4af3-851b-fa13d97ad8b1" containerID="aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae" exitCode=0
Sep 11 21:12:49.054452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.054290    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69546474db-rbwgw"
Sep 11 21:12:49.054452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.054331    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69546474db-rbwgw" event={"ID":"7de2f683-81d7-4af3-851b-fa13d97ad8b1","Type":"ContainerDied","Data":"aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae"}
Sep 11 21:12:49.054452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.054382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69546474db-rbwgw" event={"ID":"7de2f683-81d7-4af3-851b-fa13d97ad8b1","Type":"ContainerDied","Data":"5b74cc7a240f007520c97c7a9855ce78ff9b11281412ff1a1cf0ce6cb6b1d31c"}
Sep 11 21:12:49.054452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.054402    2585 scope.go:117] "RemoveContainer" containerID="aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae"
Sep 11 21:12:49.063465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.063447    2585 scope.go:117] "RemoveContainer" containerID="aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae"
Sep 11 21:12:49.063751 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:12:49.063733    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae\": container with ID starting with aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae not found: ID does not exist" containerID="aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae"
Sep 11 21:12:49.063802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.063760    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae"} err="failed to get container status \"aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae\": rpc error: code = NotFound desc = could not find container \"aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae\": container with ID starting with aced00d06d554997af9863d5b727547e32aa14993f072a0bb4f9963d99e86eae not found: ID does not exist"
Sep 11 21:12:49.095983 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.095957    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69546474db-rbwgw"]
Sep 11 21:12:49.105778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.105756    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69546474db-rbwgw"]
Sep 11 21:12:49.886418 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:49.886386    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de2f683-81d7-4af3-851b-fa13d97ad8b1" path="/var/lib/kubelet/pods/7de2f683-81d7-4af3-851b-fa13d97ad8b1/volumes"
Sep 11 21:12:52.642218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:52.642184    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:52.745293 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:52.745256    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:57.390170 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:57.390062    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:12:57.490684 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:12:57.490630    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:01.209018 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:01.208981    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:01.268973 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:01.268931    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:01.792268 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:01.792230    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:01.901931 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:01.901902    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:03.685773 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.685740    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"]
Sep 11 21:13:03.686165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.686110    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de2f683-81d7-4af3-851b-fa13d97ad8b1" containerName="console"
Sep 11 21:13:03.686165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.686123    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de2f683-81d7-4af3-851b-fa13d97ad8b1" containerName="console"
Sep 11 21:13:03.686238 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.686174    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de2f683-81d7-4af3-851b-fa13d97ad8b1" containerName="console"
Sep 11 21:13:03.689065 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.689045    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.691332 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.691310    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-jkxbz\""
Sep 11 21:13:03.702403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.702381    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"]
Sep 11 21:13:03.716248 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.716224    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:03.812834 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.812806    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.812953 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.812845    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.812953 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.812886    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.812953 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.812929    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.813122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.812968    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nh9r\" (UniqueName: \"kubernetes.io/projected/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-kube-api-access-5nh9r\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.813122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.813007    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.813122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.813044    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.813122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.813061    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.813122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.813077    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.893392 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.893365    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:03.913999 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.913970    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nh9r\" (UniqueName: \"kubernetes.io/projected/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-kube-api-access-5nh9r\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914008    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914032    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914047    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914066    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914113    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914144    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914182    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914551 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914412    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914551 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914509    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914551 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914543    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914689 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914575    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.914896 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.914877    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.916399 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.916380    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.916615 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.916598    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.922904 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.922883    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.923001 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.922919    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nh9r\" (UniqueName: \"kubernetes.io/projected/b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2-kube-api-access-5nh9r\") pod \"maas-default-gateway-openshift-default-78bb78ff78-2rp55\" (UID: \"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:03.998966 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:03.998887    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:04.278292 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:04.278268    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"]
Sep 11 21:13:04.279726 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:13:04.279700    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4a2e5fa_e99f_48c8_8a3b_3ad1adddd1b2.slice/crio-deb1231ab3dae907c2343b509bc3472fe4b7bddf8d6d1af25f8fb6808e55459b WatchSource:0}: Error finding container deb1231ab3dae907c2343b509bc3472fe4b7bddf8d6d1af25f8fb6808e55459b: Status 404 returned error can't find the container with id deb1231ab3dae907c2343b509bc3472fe4b7bddf8d6d1af25f8fb6808e55459b
Sep 11 21:13:05.137486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:05.137454    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" event={"ID":"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2","Type":"ContainerStarted","Data":"deb1231ab3dae907c2343b509bc3472fe4b7bddf8d6d1af25f8fb6808e55459b"}
Sep 11 21:13:06.398890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:06.398844    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:06.493557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:06.493505    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:06.797817 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:06.797783    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:06.896847 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:06.896809    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:07.200772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:07.200676    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:07.230349 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:07.230313    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:13:07.230499 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:07.230398    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:13:07.230499 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:07.230446    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:13:07.300169 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:07.300139    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:08.155623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:08.155586    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" event={"ID":"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2","Type":"ContainerStarted","Data":"7591c78051460c3ba7184d850f5978374302c884baa9b3f4e952e2383c3fbfcc"}
Sep 11 21:13:08.183442 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:08.183392    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" podStartSLOduration=2.235060712 podStartE2EDuration="5.183376551s" totalImagesPullingTime="2.948315839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:13:08.181662678 +0000 UTC m=+456.773176025" watchObservedRunningTime="2026-09-11 21:13:08.183376551 +0000 UTC m=+456.774889875"
Sep 11 21:13:08.267527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:08.267499    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:08.999407 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:08.999371    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:09.004492 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.004468    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:09.161415 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.161381    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:09.162158 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.162140    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:13:09.275918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.275840    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:09.277522 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.277497    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:09.279651 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.279621    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.281990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.281961    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 21:13:09.282080 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.281996    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hk78l\""
Sep 11 21:13:09.289264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.289243    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:09.350837 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.350803    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvxvt\" (UniqueName: \"kubernetes.io/projected/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-kube-api-access-rvxvt\") pod \"limitador-limitador-8588749977-zzrfz\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") " pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.350991 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.350920    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-config-file\") pod \"limitador-limitador-8588749977-zzrfz\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") " pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.373397 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.373368    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:09.375246 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.375221    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:09.451849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.451823    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-config-file\") pod \"limitador-limitador-8588749977-zzrfz\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") " pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.451974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.451870    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvxvt\" (UniqueName: \"kubernetes.io/projected/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-kube-api-access-rvxvt\") pod \"limitador-limitador-8588749977-zzrfz\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") " pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.452464 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.452438    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-config-file\") pod \"limitador-limitador-8588749977-zzrfz\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") " pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.461701 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.461676    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvxvt\" (UniqueName: \"kubernetes.io/projected/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-kube-api-access-rvxvt\") pod \"limitador-limitador-8588749977-zzrfz\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") " pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.476878 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.476847    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:09.590322 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.590298    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:09.866224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:09.866194    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:09.867929 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:13:09.867897    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b638e6e_ed94_44aa_97b8_3853b51d3e0c.slice/crio-c28972132d7d597452d35b0dca5e9f48485ac8c677623bd1287c014eda48f484 WatchSource:0}: Error finding container c28972132d7d597452d35b0dca5e9f48485ac8c677623bd1287c014eda48f484: Status 404 returned error can't find the container with id c28972132d7d597452d35b0dca5e9f48485ac8c677623bd1287c014eda48f484
Sep 11 21:13:10.167616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:10.167535    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz" event={"ID":"2b638e6e-ed94-44aa-97b8-3853b51d3e0c","Type":"ContainerStarted","Data":"c28972132d7d597452d35b0dca5e9f48485ac8c677623bd1287c014eda48f484"}
Sep 11 21:13:10.266131 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:10.266098    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:10.354043 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:10.354002    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:11.177941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:11.177843    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz" event={"ID":"2b638e6e-ed94-44aa-97b8-3853b51d3e0c","Type":"ContainerStarted","Data":"98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e"}
Sep 11 21:13:11.177941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:11.177925    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:11.207107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:11.207057    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz" podStartSLOduration=1.196374235 podStartE2EDuration="2.207039408s" totalImagesPullingTime="1.010665173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:13:11.205816171 +0000 UTC m=+459.797329494" watchObservedRunningTime="2026-09-11 21:13:11.207039408 +0000 UTC m=+459.798552736"
Sep 11 21:13:12.557910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:12.557871    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:12.650696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:12.650656    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:17.313093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:17.313055    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:17.416789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:17.416757    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:22.184034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:22.183999    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:23.680936 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:23.680901    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:23.681366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:23.681120    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz" podUID="2b638e6e-ed94-44aa-97b8-3853b51d3e0c" containerName="limitador" containerID="cri-o://98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e" gracePeriod=30
Sep 11 21:13:24.224125 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.224097    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:24.248438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.248369    2585 generic.go:356] "Generic (PLEG): container finished" podID="2b638e6e-ed94-44aa-97b8-3853b51d3e0c" containerID="98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e" exitCode=0
Sep 11 21:13:24.248438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.248407    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz"
Sep 11 21:13:24.248600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.248444    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz" event={"ID":"2b638e6e-ed94-44aa-97b8-3853b51d3e0c","Type":"ContainerDied","Data":"98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e"}
Sep 11 21:13:24.248600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.248496    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-zzrfz" event={"ID":"2b638e6e-ed94-44aa-97b8-3853b51d3e0c","Type":"ContainerDied","Data":"c28972132d7d597452d35b0dca5e9f48485ac8c677623bd1287c014eda48f484"}
Sep 11 21:13:24.248600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.248519    2585 scope.go:117] "RemoveContainer" containerID="98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e"
Sep 11 21:13:24.257326 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.257310    2585 scope.go:117] "RemoveContainer" containerID="98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e"
Sep 11 21:13:24.257575 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:13:24.257555    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e\": container with ID starting with 98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e not found: ID does not exist" containerID="98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e"
Sep 11 21:13:24.257665 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.257588    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e"} err="failed to get container status \"98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e\": rpc error: code = NotFound desc = could not find container \"98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e\": container with ID starting with 98adf526e0aee35b1d43877baddfbc952c7061e0cb56a01c86a2dfd83370f50e not found: ID does not exist"
Sep 11 21:13:24.263933 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.263916    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvxvt\" (UniqueName: \"kubernetes.io/projected/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-kube-api-access-rvxvt\") pod \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") "
Sep 11 21:13:24.263984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.263967    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-config-file\") pod \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\" (UID: \"2b638e6e-ed94-44aa-97b8-3853b51d3e0c\") "
Sep 11 21:13:24.264304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.264285    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-config-file" (OuterVolumeSpecName: "config-file") pod "2b638e6e-ed94-44aa-97b8-3853b51d3e0c" (UID: "2b638e6e-ed94-44aa-97b8-3853b51d3e0c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:13:24.265937 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.265909    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-kube-api-access-rvxvt" (OuterVolumeSpecName: "kube-api-access-rvxvt") pod "2b638e6e-ed94-44aa-97b8-3853b51d3e0c" (UID: "2b638e6e-ed94-44aa-97b8-3853b51d3e0c"). InnerVolumeSpecName "kube-api-access-rvxvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:13:24.365271 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.365247    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvxvt\" (UniqueName: \"kubernetes.io/projected/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-kube-api-access-rvxvt\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:13:24.365271 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.365270    2585 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b638e6e-ed94-44aa-97b8-3853b51d3e0c-config-file\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:13:24.570594 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.570563    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:24.574104 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:24.574079    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-zzrfz"]
Sep 11 21:13:25.484110 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.484074    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:25.640575 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.640540    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:25.885720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.885688    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b638e6e-ed94-44aa-97b8-3853b51d3e0c" path="/var/lib/kubelet/pods/2b638e6e-ed94-44aa-97b8-3853b51d3e0c/volumes"
Sep 11 21:13:25.935701 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.935663    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"]
Sep 11 21:13:25.936009 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.935995    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b638e6e-ed94-44aa-97b8-3853b51d3e0c" containerName="limitador"
Sep 11 21:13:25.936009 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.936008    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b638e6e-ed94-44aa-97b8-3853b51d3e0c" containerName="limitador"
Sep 11 21:13:25.936171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.936083    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b638e6e-ed94-44aa-97b8-3853b51d3e0c" containerName="limitador"
Sep 11 21:13:25.939128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.939106    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:25.941715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.941691    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 21:13:25.942418 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.942398    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 21:13:25.942513 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.942443    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xzmmt\""
Sep 11 21:13:25.942513 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.942453    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:13:25.947086 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.947060    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"]
Sep 11 21:13:25.966253 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.966226    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:25.975196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.975177    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztdp8\" (UniqueName: \"kubernetes.io/projected/b9b8ac0b-8a3e-4336-9a44-9307df57388c-kube-api-access-ztdp8\") pod \"postgres-69fb4594cf-8vbqk\" (UID: \"b9b8ac0b-8a3e-4336-9a44-9307df57388c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:25.975290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:25.975209    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b9b8ac0b-8a3e-4336-9a44-9307df57388c-data\") pod \"postgres-69fb4594cf-8vbqk\" (UID: \"b9b8ac0b-8a3e-4336-9a44-9307df57388c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:26.076623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:26.076592    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b9b8ac0b-8a3e-4336-9a44-9307df57388c-data\") pod \"postgres-69fb4594cf-8vbqk\" (UID: \"b9b8ac0b-8a3e-4336-9a44-9307df57388c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:26.076765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:26.076702    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztdp8\" (UniqueName: \"kubernetes.io/projected/b9b8ac0b-8a3e-4336-9a44-9307df57388c-kube-api-access-ztdp8\") pod \"postgres-69fb4594cf-8vbqk\" (UID: \"b9b8ac0b-8a3e-4336-9a44-9307df57388c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:26.076947 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:26.076927    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b9b8ac0b-8a3e-4336-9a44-9307df57388c-data\") pod \"postgres-69fb4594cf-8vbqk\" (UID: \"b9b8ac0b-8a3e-4336-9a44-9307df57388c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:26.089929 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:26.089906    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztdp8\" (UniqueName: \"kubernetes.io/projected/b9b8ac0b-8a3e-4336-9a44-9307df57388c-kube-api-access-ztdp8\") pod \"postgres-69fb4594cf-8vbqk\" (UID: \"b9b8ac0b-8a3e-4336-9a44-9307df57388c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:26.250959 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:26.250894    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:26.523888 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:26.523863    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"]
Sep 11 21:13:26.525956 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:13:26.525928    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b8ac0b_8a3e_4336_9a44_9307df57388c.slice/crio-92c9b291380feee021e29b6a30b0a204ea92abc71b83131aee0446a415c5aafd WatchSource:0}: Error finding container 92c9b291380feee021e29b6a30b0a204ea92abc71b83131aee0446a415c5aafd: Status 404 returned error can't find the container with id 92c9b291380feee021e29b6a30b0a204ea92abc71b83131aee0446a415c5aafd
Sep 11 21:13:27.267003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:27.266967    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk" event={"ID":"b9b8ac0b-8a3e-4336-9a44-9307df57388c","Type":"ContainerStarted","Data":"92c9b291380feee021e29b6a30b0a204ea92abc71b83131aee0446a415c5aafd"}
Sep 11 21:13:32.298610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:32.298572    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk" event={"ID":"b9b8ac0b-8a3e-4336-9a44-9307df57388c","Type":"ContainerStarted","Data":"70cc46d7c7eebd7a6bdd9bd1fa3ac3ee320f4c2b537855b9a90d236874692552"}
Sep 11 21:13:32.299070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:32.298649    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:38.332015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:38.331984    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk"
Sep 11 21:13:38.350204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:38.350157    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-8vbqk" podStartSLOduration=8.307955023 podStartE2EDuration="13.350141814s" totalImagesPullingTime="5.042186791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:13:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:13:32.320245334 +0000 UTC m=+480.911758658" watchObservedRunningTime="2026-09-11 21:13:38.350141814 +0000 UTC m=+486.941655137"
Sep 11 21:13:38.655916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:38.655832    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:38.756327 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:38.756289    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:40.815916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:40.815877    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:45.778559 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.778505    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:45.819274 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.819236    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bfb684f4-6nw6x"]
Sep 11 21:13:45.848353 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.848312    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfb684f4-6nw6x"]
Sep 11 21:13:45.848543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.848410    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:45.851534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.851507    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:13:45.851534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.851520    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:13:45.851796 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.851556    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:13:45.851796 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.851569    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ncdvn\""
Sep 11 21:13:45.871890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.871860    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:45.929053 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.929024    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:45.930900 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.930881    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-webhook-cert\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:45.930997 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.930909    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x82sm\" (UniqueName: \"kubernetes.io/projected/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-kube-api-access-x82sm\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:45.931038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:45.931010    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-metrics-certs\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.021813 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.021779    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8499ccbc4-mbz6d"]
Sep 11 21:13:46.025282 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.025266    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.032023 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.031998    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-metrics-certs\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.032274 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.032251    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-webhook-cert\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.032540 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.032521    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82sm\" (UniqueName: \"kubernetes.io/projected/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-kube-api-access-x82sm\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.035431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.035395    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-webhook-cert\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.035555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.035502    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-metrics-certs\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.035555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.035529    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-mbz6d"]
Sep 11 21:13:46.040955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.040937    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x82sm\" (UniqueName: \"kubernetes.io/projected/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-kube-api-access-x82sm\") pod \"maas-controller-7bfb684f4-6nw6x\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") " pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.134148 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.134113    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-webhook-cert\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.134311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.134169    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-metrics-certs\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.134311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.134229    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c27rx\" (UniqueName: \"kubernetes.io/projected/75bf5395-6511-4a47-8cde-0f35f98d42db-kube-api-access-c27rx\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.158660 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.158617    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:46.253494 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.253432    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-webhook-cert\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.253696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.253502    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-metrics-certs\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.253696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.253544    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c27rx\" (UniqueName: \"kubernetes.io/projected/75bf5395-6511-4a47-8cde-0f35f98d42db-kube-api-access-c27rx\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.259366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.259335    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-webhook-cert\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.259786 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.259767    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-metrics-certs\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.263216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.263190    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c27rx\" (UniqueName: \"kubernetes.io/projected/75bf5395-6511-4a47-8cde-0f35f98d42db-kube-api-access-c27rx\") pod \"maas-controller-8499ccbc4-mbz6d\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") " pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.338288 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.338236    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:46.430538 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.430516    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bfb684f4-6nw6x"]
Sep 11 21:13:46.432918 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:13:46.432878    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b22edca_3fad_47d7_b3ed_6ae9ebd5d904.slice/crio-2eae1023ff748b0ddaec0a3d92f923f578d9cae1e778c9fa3ac256a4921e250d WatchSource:0}: Error finding container 2eae1023ff748b0ddaec0a3d92f923f578d9cae1e778c9fa3ac256a4921e250d: Status 404 returned error can't find the container with id 2eae1023ff748b0ddaec0a3d92f923f578d9cae1e778c9fa3ac256a4921e250d
Sep 11 21:13:46.613844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:46.613820    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-mbz6d"]
Sep 11 21:13:46.615538 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:13:46.615511    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bf5395_6511_4a47_8cde_0f35f98d42db.slice/crio-dfeadf340ba8d2bfbc0fd43bf6f5f636b22a385f9fd5b6beb23252e0e4f6281e WatchSource:0}: Error finding container dfeadf340ba8d2bfbc0fd43bf6f5f636b22a385f9fd5b6beb23252e0e4f6281e: Status 404 returned error can't find the container with id dfeadf340ba8d2bfbc0fd43bf6f5f636b22a385f9fd5b6beb23252e0e4f6281e
Sep 11 21:13:47.384458 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:47.384380    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfb684f4-6nw6x" event={"ID":"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904","Type":"ContainerStarted","Data":"2eae1023ff748b0ddaec0a3d92f923f578d9cae1e778c9fa3ac256a4921e250d"}
Sep 11 21:13:47.386388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:47.386308    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-mbz6d" event={"ID":"75bf5395-6511-4a47-8cde-0f35f98d42db","Type":"ContainerStarted","Data":"dfeadf340ba8d2bfbc0fd43bf6f5f636b22a385f9fd5b6beb23252e0e4f6281e"}
Sep 11 21:13:49.181091 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.181049    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:49.294848 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.294818    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:13:49.401405 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.401366    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfb684f4-6nw6x" event={"ID":"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904","Type":"ContainerStarted","Data":"74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0"}
Sep 11 21:13:49.401597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.401449    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:13:49.403484 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.403455    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-mbz6d" event={"ID":"75bf5395-6511-4a47-8cde-0f35f98d42db","Type":"ContainerStarted","Data":"5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34"}
Sep 11 21:13:49.403611 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.403508    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:13:49.434038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.433995    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bfb684f4-6nw6x" podStartSLOduration=1.8826539960000002 podStartE2EDuration="4.433972799s" totalImagesPullingTime="2.551318803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:13:49.43048453 +0000 UTC m=+498.021997852" watchObservedRunningTime="2026-09-11 21:13:49.433972799 +0000 UTC m=+498.025486175"
Sep 11 21:13:49.457599 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:13:49.457559    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8499ccbc4-mbz6d" podStartSLOduration=1.081941758 podStartE2EDuration="3.457523572s" totalImagesPullingTime="2.375581814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:13:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:13:49.456583875 +0000 UTC m=+498.048097197" watchObservedRunningTime="2026-09-11 21:13:49.457523572 +0000 UTC m=+498.049036894"
Sep 11 21:14:00.411713 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.411686    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:14:00.412136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.411750    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:14:00.533444 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.533414    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfb684f4-6nw6x"]
Sep 11 21:14:00.533684 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.533653    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bfb684f4-6nw6x" podUID="1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" containerName="manager" containerID="cri-o://74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0" gracePeriod=30
Sep 11 21:14:00.779044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.779020    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:14:00.884020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.883991    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-webhook-cert\") pod \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") "
Sep 11 21:14:00.884020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.884021    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-metrics-certs\") pod \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") "
Sep 11 21:14:00.884208 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.884078    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x82sm\" (UniqueName: \"kubernetes.io/projected/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-kube-api-access-x82sm\") pod \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\" (UID: \"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904\") "
Sep 11 21:14:00.886204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.886178    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" (UID: "1b22edca-3fad-47d7-b3ed-6ae9ebd5d904"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:14:00.886295 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.886251    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-kube-api-access-x82sm" (OuterVolumeSpecName: "kube-api-access-x82sm") pod "1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" (UID: "1b22edca-3fad-47d7-b3ed-6ae9ebd5d904"). InnerVolumeSpecName "kube-api-access-x82sm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:14:00.886339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.886294    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" (UID: "1b22edca-3fad-47d7-b3ed-6ae9ebd5d904"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:14:00.985082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.985014    2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-webhook-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:14:00.985082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.985049    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:14:00.985082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:00.985064    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x82sm\" (UniqueName: \"kubernetes.io/projected/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904-kube-api-access-x82sm\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:14:01.469442 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.469414    2585 generic.go:356] "Generic (PLEG): container finished" podID="1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" containerID="74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0" exitCode=0
Sep 11 21:14:01.469819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.469453    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bfb684f4-6nw6x"
Sep 11 21:14:01.469819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.469475    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfb684f4-6nw6x" event={"ID":"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904","Type":"ContainerDied","Data":"74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0"}
Sep 11 21:14:01.469819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.469518    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bfb684f4-6nw6x" event={"ID":"1b22edca-3fad-47d7-b3ed-6ae9ebd5d904","Type":"ContainerDied","Data":"2eae1023ff748b0ddaec0a3d92f923f578d9cae1e778c9fa3ac256a4921e250d"}
Sep 11 21:14:01.469819 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.469544    2585 scope.go:117] "RemoveContainer" containerID="74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0"
Sep 11 21:14:01.479792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.479774    2585 scope.go:117] "RemoveContainer" containerID="74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0"
Sep 11 21:14:01.480044 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:14:01.480026    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0\": container with ID starting with 74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0 not found: ID does not exist" containerID="74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0"
Sep 11 21:14:01.480095 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.480052    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0"} err="failed to get container status \"74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0\": rpc error: code = NotFound desc = could not find container \"74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0\": container with ID starting with 74cb8d8c1b9f1926d2781e8fa8df036e3dbc5a440d4480803c67c5ffe1c1d9e0 not found: ID does not exist"
Sep 11 21:14:01.495608 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.493620    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bfb684f4-6nw6x"]
Sep 11 21:14:01.501491 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.501470    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bfb684f4-6nw6x"]
Sep 11 21:14:01.885723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:01.885688    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" path="/var/lib/kubelet/pods/1b22edca-3fad-47d7-b3ed-6ae9ebd5d904/volumes"
Sep 11 21:14:21.827655 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:21.827601    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:21.926219 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:21.926181    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:23.290175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.290137    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:23.391186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.391147    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:23.416192 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.416159    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-jstg7"]
Sep 11 21:14:23.416530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.416518    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" containerName="manager"
Sep 11 21:14:23.416586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.416531    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" containerName="manager"
Sep 11 21:14:23.416624 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.416607    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b22edca-3fad-47d7-b3ed-6ae9ebd5d904" containerName="manager"
Sep 11 21:14:23.422881 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.422862    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.425499 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.425478    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 21:14:23.426122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.426109    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4pvmq\""
Sep 11 21:14:23.426185 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.426118    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 21:14:23.434186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.434161    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-jstg7"]
Sep 11 21:14:23.468179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.468152    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9rq\" (UniqueName: \"kubernetes.io/projected/b6100738-b0c0-42c1-b72e-397d492c30f2-kube-api-access-7c9rq\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.468328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.468191    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.468328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.468220    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6100738-b0c0-42c1-b72e-397d492c30f2-openshift-service-ca\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.468328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.468286    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-maas-api-tls\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.490092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.490059    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:23.568792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.568692    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6100738-b0c0-42c1-b72e-397d492c30f2-openshift-service-ca\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.568792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.568726    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-maas-api-tls\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.568792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.568792    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9rq\" (UniqueName: \"kubernetes.io/projected/b6100738-b0c0-42c1-b72e-397d492c30f2-kube-api-access-7c9rq\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.569106 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.568845    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.569106 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:14:23.568950    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 11 21:14:23.569106 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:14:23.569006    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs podName:b6100738-b0c0-42c1-b72e-397d492c30f2 nodeName:}" failed. No retries permitted until 2026-09-11 21:14:24.068990082 +0000 UTC m=+532.660503382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs") pod "maas-api-84585bc567-jstg7" (UID: "b6100738-b0c0-42c1-b72e-397d492c30f2") : secret "maas-api-metrics-tls" not found
Sep 11 21:14:23.569290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.569274    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6100738-b0c0-42c1-b72e-397d492c30f2-openshift-service-ca\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.571360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.571332    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-maas-api-tls\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.580435 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.580414    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9rq\" (UniqueName: \"kubernetes.io/projected/b6100738-b0c0-42c1-b72e-397d492c30f2-kube-api-access-7c9rq\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:23.641113 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.641081    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:23.805837 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.805799    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:23.903676 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:23.903570    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:24.073329 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:24.073298    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:24.075792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:24.075771    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs\") pod \"maas-api-84585bc567-jstg7\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") " pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:24.333299 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:24.333260    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:24.609251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:24.609180    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-jstg7"]
Sep 11 21:14:24.625218 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:14:24.625181    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6100738_b0c0_42c1_b72e_397d492c30f2.slice/crio-df558765b84c8464316c39a75a390c6ed04e1a556e9800aa3a69b71e7aa918a4 WatchSource:0}: Error finding container df558765b84c8464316c39a75a390c6ed04e1a556e9800aa3a69b71e7aa918a4: Status 404 returned error can't find the container with id df558765b84c8464316c39a75a390c6ed04e1a556e9800aa3a69b71e7aa918a4
Sep 11 21:14:25.621681 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:25.621609    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7" event={"ID":"b6100738-b0c0-42c1-b72e-397d492c30f2","Type":"ContainerStarted","Data":"df558765b84c8464316c39a75a390c6ed04e1a556e9800aa3a69b71e7aa918a4"}
Sep 11 21:14:27.634298 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:27.634262    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7" event={"ID":"b6100738-b0c0-42c1-b72e-397d492c30f2","Type":"ContainerStarted","Data":"8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc"}
Sep 11 21:14:27.634781 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:27.634340    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:27.653402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:27.653360    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7" podStartSLOduration=2.634155784 podStartE2EDuration="4.653345286s" totalImagesPullingTime="2.019189502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:14:27.652253531 +0000 UTC m=+536.243766854" watchObservedRunningTime="2026-09-11 21:14:27.653345286 +0000 UTC m=+536.244858608"
Sep 11 21:14:32.662540 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:32.662509    2585 generic.go:356] "Generic (PLEG): container finished" podID="b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2" containerID="7591c78051460c3ba7184d850f5978374302c884baa9b3f4e952e2383c3fbfcc" exitCode=0
Sep 11 21:14:32.662985 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:32.662586    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" event={"ID":"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2","Type":"ContainerDied","Data":"7591c78051460c3ba7184d850f5978374302c884baa9b3f4e952e2383c3fbfcc"}
Sep 11 21:14:32.663059 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:32.662984    2585 scope.go:117] "RemoveContainer" containerID="7591c78051460c3ba7184d850f5978374302c884baa9b3f4e952e2383c3fbfcc"
Sep 11 21:14:32.663986 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:32.663949    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:14:32.664098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:32.664024    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:14:32.664098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:32.664059    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 21:14:33.644989 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:33.644964    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:14:33.670979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:33.670949    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" event={"ID":"b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2","Type":"ContainerStarted","Data":"9ea3aa71e1688d038a8015cdedcd3f707a1f95c6355717053c97fe27a4654043"}
Sep 11 21:14:33.999380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:33.999281    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:14:33.999699 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:33.999668    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2rp55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 11 21:14:33.999940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:33.999914    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" podUID="b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 11 21:14:34.852446 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:34.852413    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:34.945844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:34.945804    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:35.015196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:35.015157    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2rp55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 11 21:14:35.015530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:35.015499    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" podUID="b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 11 21:14:35.999691 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:35.999629    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2rp55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 11 21:14:36.000289 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:36.000254    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" podUID="b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 11 21:14:36.977068 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:36.977030    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:37.000205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:37.000159    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2rp55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 11 21:14:37.000699 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:37.000247    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" podUID="b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 11 21:14:38.000493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:38.000444    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-2rp55 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Sep 11 21:14:38.001058 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:38.000531    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55" podUID="b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Sep 11 21:14:39.003065 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:39.003028    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:14:39.003519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:39.003309    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:14:39.004101 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:39.004082    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-2rp55"
Sep 11 21:14:48.033688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.033655    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"]
Sep 11 21:14:48.038157 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.038138    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.040674 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.040629    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m6p5f\""
Sep 11 21:14:48.040779 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.040762    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 21:14:48.041299 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.041286    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 21:14:48.041400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.041306    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 21:14:48.046067 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.045750    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"]
Sep 11 21:14:48.057305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.057261    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:48.216279 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.216244    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdw25\" (UniqueName: \"kubernetes.io/projected/bac0837a-4d20-438d-a45c-717984d603ba-kube-api-access-kdw25\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.216462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.216307    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac0837a-4d20-438d-a45c-717984d603ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.216462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.216387    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.216462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.216445    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.216597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.216468    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.216597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.216497    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.317677 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.317573    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdw25\" (UniqueName: \"kubernetes.io/projected/bac0837a-4d20-438d-a45c-717984d603ba-kube-api-access-kdw25\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.317677 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.317631    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac0837a-4d20-438d-a45c-717984d603ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.317877 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.317691    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.317877 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.317821    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.317877 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.317857    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.318010 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.317899    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.318168 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.318144    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.318256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.318199    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.318256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.318227    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.320044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.320010    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bac0837a-4d20-438d-a45c-717984d603ba-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.320143 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.320127    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bac0837a-4d20-438d-a45c-717984d603ba-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.326873 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.326850    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdw25\" (UniqueName: \"kubernetes.io/projected/bac0837a-4d20-438d-a45c-717984d603ba-kube-api-access-kdw25\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54\" (UID: \"bac0837a-4d20-438d-a45c-717984d603ba\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.349728 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.349696    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:48.627169 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.627137    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"]
Sep 11 21:14:48.628488 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:14:48.628457    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac0837a_4d20_438d_a45c_717984d603ba.slice/crio-8b0d720853505d250281bac592fcadf13280a571eefc037cd72d3ff4262b83d8 WatchSource:0}: Error finding container 8b0d720853505d250281bac592fcadf13280a571eefc037cd72d3ff4262b83d8: Status 404 returned error can't find the container with id 8b0d720853505d250281bac592fcadf13280a571eefc037cd72d3ff4262b83d8
Sep 11 21:14:48.754161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:48.754126    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54" event={"ID":"bac0837a-4d20-438d-a45c-717984d603ba","Type":"ContainerStarted","Data":"8b0d720853505d250281bac592fcadf13280a571eefc037cd72d3ff4262b83d8"}
Sep 11 21:14:50.766813 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:50.766770    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54" event={"ID":"bac0837a-4d20-438d-a45c-717984d603ba","Type":"ContainerStarted","Data":"8fdf4adc3ee86995d944261aba40d23567dbdd0d5047ed241f0e96924d658a95"}
Sep 11 21:14:50.788616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:50.788566    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54" podStartSLOduration=1.669558885 podStartE2EDuration="2.788550928s" totalImagesPullingTime="1.118992043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:14:50.787324134 +0000 UTC m=+559.378837457" watchObservedRunningTime="2026-09-11 21:14:50.788550928 +0000 UTC m=+559.380064250"
Sep 11 21:14:56.615423 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.615385    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"]
Sep 11 21:14:56.625553 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.625523    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.628019 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.627992    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 21:14:56.632177 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.632154    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"]
Sep 11 21:14:56.656965 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.656939    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:14:56.692299 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.692272    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.692480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.692315    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bcf0da5-6342-4e62-8efd-b26284f5a896-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.692480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.692352    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.692480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.692384    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.692480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.692421    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjhwx\" (UniqueName: \"kubernetes.io/projected/7bcf0da5-6342-4e62-8efd-b26284f5a896-kube-api-access-qjhwx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.692480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.692453    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793069 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793027    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793155    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjhwx\" (UniqueName: \"kubernetes.io/projected/7bcf0da5-6342-4e62-8efd-b26284f5a896-kube-api-access-qjhwx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793193    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793413 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793380    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793450    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bcf0da5-6342-4e62-8efd-b26284f5a896-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793535 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793476    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793535 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793492    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793726    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.793842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.793777    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.795723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.795698    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bcf0da5-6342-4e62-8efd-b26284f5a896-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.796043 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.796027    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bcf0da5-6342-4e62-8efd-b26284f5a896-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.814774 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.814746    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjhwx\" (UniqueName: \"kubernetes.io/projected/7bcf0da5-6342-4e62-8efd-b26284f5a896-kube-api-access-qjhwx\") pod \"e2e-distinct-simulated-kserve-59975d69f9-bk92m\" (UID: \"7bcf0da5-6342-4e62-8efd-b26284f5a896\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:56.939034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:56.938952    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:14:57.216111 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:57.216079    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"]
Sep 11 21:14:57.217606 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:14:57.217579    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bcf0da5_6342_4e62_8efd_b26284f5a896.slice/crio-29d26e604f3bdc663e158ab474dc6693716aea0d62e682cb5bf7fb51ebbce97a WatchSource:0}: Error finding container 29d26e604f3bdc663e158ab474dc6693716aea0d62e682cb5bf7fb51ebbce97a: Status 404 returned error can't find the container with id 29d26e604f3bdc663e158ab474dc6693716aea0d62e682cb5bf7fb51ebbce97a
Sep 11 21:14:57.807130 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:57.807093    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m" event={"ID":"7bcf0da5-6342-4e62-8efd-b26284f5a896","Type":"ContainerStarted","Data":"40b354cb3b9f9f6cbdbb2fdc7026e662468f1c2bc16a69689f6cff101018d712"}
Sep 11 21:14:57.807658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:57.807145    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m" event={"ID":"7bcf0da5-6342-4e62-8efd-b26284f5a896","Type":"ContainerStarted","Data":"29d26e604f3bdc663e158ab474dc6693716aea0d62e682cb5bf7fb51ebbce97a"}
Sep 11 21:14:57.828610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:57.828561    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m" podStartSLOduration=1.649674708 podStartE2EDuration="1.828544467s" totalImagesPullingTime="178.869759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:14:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:14:57.825725513 +0000 UTC m=+566.417238836" watchObservedRunningTime="2026-09-11 21:14:57.828544467 +0000 UTC m=+566.420057790"
Sep 11 21:14:58.350562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:58.350527    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:58.350748 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:58.350587    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:58.363406 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:58.363380    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:14:58.824318 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:14:58.824291    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54"
Sep 11 21:15:04.227630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:04.227579    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:06.939672 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:06.939628    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:15:06.940132 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:06.939712    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:15:06.952138 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:06.952114    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:15:07.876112 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:07.876084    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-bk92m"
Sep 11 21:15:11.429598 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:11.429557    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:24.054470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:24.054433    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:29.723752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.723716    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"]
Sep 11 21:15:29.727474 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.727452    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.729926 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.729908    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 21:15:29.738320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.738297    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"]
Sep 11 21:15:29.747380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.747354    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:29.877720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.877688    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.877720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.877719    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmpp\" (UniqueName: \"kubernetes.io/projected/068af4f9-229f-4437-bce9-2b30714dcf71-kube-api-access-drmpp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.877916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.877763    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.877916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.877862    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.877916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.877889    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.877916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.877910    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068af4f9-229f-4437-bce9-2b30714dcf71-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.978629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.978554    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.978629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.978587    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmpp\" (UniqueName: \"kubernetes.io/projected/068af4f9-229f-4437-bce9-2b30714dcf71-kube-api-access-drmpp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.978868 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.978660    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.978868 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.978797    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.978868 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.978824    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.978868 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.978850    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068af4f9-229f-4437-bce9-2b30714dcf71-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.979098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.979005    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.979098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.979046    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.979236 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.979213    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.981211 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.981189    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/068af4f9-229f-4437-bce9-2b30714dcf71-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.981512 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.981490    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/068af4f9-229f-4437-bce9-2b30714dcf71-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:29.987770 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:29.987738    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmpp\" (UniqueName: \"kubernetes.io/projected/068af4f9-229f-4437-bce9-2b30714dcf71-kube-api-access-drmpp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-v7s97\" (UID: \"068af4f9-229f-4437-bce9-2b30714dcf71\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:30.038306 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:30.038280    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:30.315058 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:30.315030    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"]
Sep 11 21:15:30.315441 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:15:30.315414    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068af4f9_229f_4437_bce9_2b30714dcf71.slice/crio-83ad4ddf70a961491bc7e875626ea0e1e7e644d6b9e7b484b447f5685b17748d WatchSource:0}: Error finding container 83ad4ddf70a961491bc7e875626ea0e1e7e644d6b9e7b484b447f5685b17748d: Status 404 returned error can't find the container with id 83ad4ddf70a961491bc7e875626ea0e1e7e644d6b9e7b484b447f5685b17748d
Sep 11 21:15:30.989421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:30.989375    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97" event={"ID":"068af4f9-229f-4437-bce9-2b30714dcf71","Type":"ContainerStarted","Data":"0b408ec9779e8abc346f388d548061c589cf528b5449dea57883479b20b6708c"}
Sep 11 21:15:30.989898 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:30.989437    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97" event={"ID":"068af4f9-229f-4437-bce9-2b30714dcf71","Type":"ContainerStarted","Data":"83ad4ddf70a961491bc7e875626ea0e1e7e644d6b9e7b484b447f5685b17748d"}
Sep 11 21:15:31.009983 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.009878    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97" podStartSLOduration=1.8363561320000001 podStartE2EDuration="2.009857908s" totalImagesPullingTime="173.501776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:15:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:15:31.009394741 +0000 UTC m=+599.600908064" watchObservedRunningTime="2026-09-11 21:15:31.009857908 +0000 UTC m=+599.601371231"
Sep 11 21:15:31.382693 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.382653    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:31.496472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.496434    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:31.878434 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.878403    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:15:31.880558 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.880532    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:15:31.884933 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.884914    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:15:31.887000 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:31.886978    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:15:40.039143 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:40.039115    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:40.039541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:40.039168    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:40.051557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:40.051528    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:41.054019 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:41.053979    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-v7s97"
Sep 11 21:15:43.168909 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:43.168868    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:52.976562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:52.976520    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:15:53.076755 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:15:53.076732    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:13.377404 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:13.377359    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:13.477591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:13.477551    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:31.059472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:31.059435    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:31.165930 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:31.165898    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:32.336565 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:32.336532    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:32.522738 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:32.522689    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:47.877855 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:47.877819    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:47.975361 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:47.975328    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:48.081990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:48.081956    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:48.330421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:48.330392    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:48.478794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:48.478759    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:48.605907 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:48.605802    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:48.711702 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:48.711669    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:48.801403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:48.801366    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:49.354866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:49.354831    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:49.454365 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:49.454329    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:49.816083 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:49.816048    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:51.570599 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:51.570562    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:51.838502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:51.838413    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:51.974259 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:51.974223    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:53.272463 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.272429    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"]
Sep 11 21:16:53.276339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.276311    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.278707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.278683    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-962a7d-serving-cert\""
Sep 11 21:16:53.290686 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.290666    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"]
Sep 11 21:16:53.316687 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.316657    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:53.359465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.359435    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-metrics-certs\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.359622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.359496    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.359622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.359590    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35f2fbef-7efc-464a-8a06-292102a67aa7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.359730 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.359633    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9sl8\" (UniqueName: \"kubernetes.io/projected/35f2fbef-7efc-464a-8a06-292102a67aa7-kube-api-access-j9sl8\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.420472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.420434    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:53.460956 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.460926    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-metrics-certs\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.461071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.460969    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.461071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.461008    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35f2fbef-7efc-464a-8a06-292102a67aa7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.461071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.461035    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9sl8\" (UniqueName: \"kubernetes.io/projected/35f2fbef-7efc-464a-8a06-292102a67aa7-kube-api-access-j9sl8\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.461196 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:16:53.461100    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-serving-cert: secret "maas-api-e2e-worker-w4-962a7d-serving-cert" not found
Sep 11 21:16:53.461196 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:16:53.461170    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls podName:35f2fbef-7efc-464a-8a06-292102a67aa7 nodeName:}" failed. No retries permitted until 2026-09-11 21:16:53.961150045 +0000 UTC m=+682.552663358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls") pod "maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" (UID: "35f2fbef-7efc-464a-8a06-292102a67aa7") : secret "maas-api-e2e-worker-w4-962a7d-serving-cert" not found
Sep 11 21:16:53.461722 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.461699    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35f2fbef-7efc-464a-8a06-292102a67aa7-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.463362 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.463340    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-metrics-certs\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.469514 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.469488    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9sl8\" (UniqueName: \"kubernetes.io/projected/35f2fbef-7efc-464a-8a06-292102a67aa7-kube-api-access-j9sl8\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.808750 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.808698    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:53.904497 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.904460    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:53.947543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.947514    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"]
Sep 11 21:16:53.951162 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.951145    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:53.953666 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.953617    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-962a7d\""
Sep 11 21:16:53.953777 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.953750    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-962a7d-dockercfg-6t7lv\""
Sep 11 21:16:53.965543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.965523    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"]
Sep 11 21:16:53.965948 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.965922    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqtk\" (UniqueName: \"kubernetes.io/projected/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-kube-api-access-lbqtk\") pod \"payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:53.966004 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.965981    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:53.966056 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.966016    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:53.968703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:53.968682    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls\") pod \"maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:54.006480 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.006452    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:54.066893 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.066812    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqtk\" (UniqueName: \"kubernetes.io/projected/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-kube-api-access-lbqtk\") pod \"payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:54.066893 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.066861    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:54.067538 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.067514    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:54.077456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.077432    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqtk\" (UniqueName: \"kubernetes.io/projected/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-kube-api-access-lbqtk\") pod \"payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:54.189054 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.189024    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:54.262371 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.262327    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:54.280520 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.280495    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"]
Sep 11 21:16:54.285102 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.285086    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.288407 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.288385    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-26462a-serving-cert\""
Sep 11 21:16:54.300028 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.295978    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"]
Sep 11 21:16:54.316758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.316691    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:54.369592 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.369566    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-maas-api-tls\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.369745 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.369614    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7xb4\" (UniqueName: \"kubernetes.io/projected/ebde6f00-be59-41c2-be83-ec68ddae72ba-kube-api-access-t7xb4\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.369745 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.369674    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebde6f00-be59-41c2-be83-ec68ddae72ba-openshift-service-ca\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.369854 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.369796    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-metrics-certs\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.390356 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.390332    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:54.469272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.469060    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:54.471262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.471235    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7xb4\" (UniqueName: \"kubernetes.io/projected/ebde6f00-be59-41c2-be83-ec68ddae72ba-kube-api-access-t7xb4\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.471389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.471282    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebde6f00-be59-41c2-be83-ec68ddae72ba-openshift-service-ca\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.471460 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.471399    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-metrics-certs\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.471515 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.471461    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-maas-api-tls\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.471515 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.471464    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"]
Sep 11 21:16:54.472119 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.472093    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebde6f00-be59-41c2-be83-ec68ddae72ba-openshift-service-ca\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.472308 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:16:54.472266    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35f2fbef_7efc_464a_8a06_292102a67aa7.slice/crio-28c0add9832ff3e694bdd1c245e906676bca4bdc9572e144b62c6aa6b8157cab WatchSource:0}: Error finding container 28c0add9832ff3e694bdd1c245e906676bca4bdc9572e144b62c6aa6b8157cab: Status 404 returned error can't find the container with id 28c0add9832ff3e694bdd1c245e906676bca4bdc9572e144b62c6aa6b8157cab
Sep 11 21:16:54.474862 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.474665    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-maas-api-tls\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.476094 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.475778    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:16:54.478017 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.477993    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-metrics-certs\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.485836 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.480429    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7xb4\" (UniqueName: \"kubernetes.io/projected/ebde6f00-be59-41c2-be83-ec68ddae72ba-kube-api-access-t7xb4\") pod \"maas-api-e2e-inf-a-26462a-79fffcbd4-www4p\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.555900 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.555879    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"]
Sep 11 21:16:54.556864 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:16:54.556829    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ad6f6c_4692_415f_a20c_e3d0f2bf2a7e.slice/crio-6efcf1b7fc163937cf20e6d5f1628cde7f6d3684a59c23a7e6bfaf0f253e281a WatchSource:0}: Error finding container 6efcf1b7fc163937cf20e6d5f1628cde7f6d3684a59c23a7e6bfaf0f253e281a: Status 404 returned error can't find the container with id 6efcf1b7fc163937cf20e6d5f1628cde7f6d3684a59c23a7e6bfaf0f253e281a
Sep 11 21:16:54.600248 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.600202    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:54.876630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.876604    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"]
Sep 11 21:16:54.877902 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:16:54.877878    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebde6f00_be59_41c2_be83_ec68ddae72ba.slice/crio-96f86b9b03aacce87bc2e43a112616758b4dcfc50d5f0058eae2b3ca85e5aa38 WatchSource:0}: Error finding container 96f86b9b03aacce87bc2e43a112616758b4dcfc50d5f0058eae2b3ca85e5aa38: Status 404 returned error can't find the container with id 96f86b9b03aacce87bc2e43a112616758b4dcfc50d5f0058eae2b3ca85e5aa38
Sep 11 21:16:54.947105 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:54.947080    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:55.046142 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.046110    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:55.465271 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.465238    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"]
Sep 11 21:16:55.470890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.470590    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p" event={"ID":"ebde6f00-be59-41c2-be83-ec68ddae72ba","Type":"ContainerStarted","Data":"2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf"}
Sep 11 21:16:55.470890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.470632    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p" event={"ID":"ebde6f00-be59-41c2-be83-ec68ddae72ba","Type":"ContainerStarted","Data":"96f86b9b03aacce87bc2e43a112616758b4dcfc50d5f0058eae2b3ca85e5aa38"}
Sep 11 21:16:55.470890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.470686    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:16:55.470890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.470726    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.471840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.471717    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" event={"ID":"35f2fbef-7efc-464a-8a06-292102a67aa7","Type":"ContainerStarted","Data":"59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73"}
Sep 11 21:16:55.471840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.471767    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" event={"ID":"35f2fbef-7efc-464a-8a06-292102a67aa7","Type":"ContainerStarted","Data":"28c0add9832ff3e694bdd1c245e906676bca4bdc9572e144b62c6aa6b8157cab"}
Sep 11 21:16:55.471840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.471796    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:16:55.474829 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.474806    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-ea5e33-serving-cert\""
Sep 11 21:16:55.475024 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.474997    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q" event={"ID":"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e","Type":"ContainerStarted","Data":"6efcf1b7fc163937cf20e6d5f1628cde7f6d3684a59c23a7e6bfaf0f253e281a"}
Sep 11 21:16:55.480141 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.480061    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-979mf\" (UniqueName: \"kubernetes.io/projected/a5c16cd9-7992-4534-aaa3-485e86dc286f-kube-api-access-979mf\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.481431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.481404    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c16cd9-7992-4534-aaa3-485e86dc286f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.481700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.481439    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-metrics-certs\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.481700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.481485    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.484967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.484945    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"]
Sep 11 21:16:55.497220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.497167    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p" podStartSLOduration=1.158230879 podStartE2EDuration="1.497149583s" totalImagesPullingTime="338.918704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:55.494462738 +0000 UTC m=+684.085976062" watchObservedRunningTime="2026-09-11 21:16:55.497149583 +0000 UTC m=+684.088662907"
Sep 11 21:16:55.499692 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.499667    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:55.515440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.515396    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" podStartSLOduration=2.060700259 podStartE2EDuration="2.515384838s" totalImagesPullingTime="454.684579ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:55.513549025 +0000 UTC m=+684.105062341" watchObservedRunningTime="2026-09-11 21:16:55.515384838 +0000 UTC m=+684.106898160"
Sep 11 21:16:55.576694 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.576611    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:55.582740 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.582711    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-979mf\" (UniqueName: \"kubernetes.io/projected/a5c16cd9-7992-4534-aaa3-485e86dc286f-kube-api-access-979mf\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.582887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.582769    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c16cd9-7992-4534-aaa3-485e86dc286f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.582887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.582793    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-metrics-certs\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.582887 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.582837    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.583072 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:16:55.583001    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-serving-cert: secret "maas-api-e2e-worker-w0-ea5e33-serving-cert" not found
Sep 11 21:16:55.583134 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:16:55.583076    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls podName:a5c16cd9-7992-4534-aaa3-485e86dc286f nodeName:}" failed. No retries permitted until 2026-09-11 21:16:56.083056423 +0000 UTC m=+684.674569728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls") pod "maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" (UID: "a5c16cd9-7992-4534-aaa3-485e86dc286f") : secret "maas-api-e2e-worker-w0-ea5e33-serving-cert" not found
Sep 11 21:16:55.583534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.583508    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c16cd9-7992-4534-aaa3-485e86dc286f-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.585678 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.585632    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-metrics-certs\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.591807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.591780    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-979mf\" (UniqueName: \"kubernetes.io/projected/a5c16cd9-7992-4534-aaa3-485e86dc286f-kube-api-access-979mf\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:55.690701 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:55.690667    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:56.062771 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.062741    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:56.087545 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.087507    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:56.090128 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.090106    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls\") pod \"maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:56.091944 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.091921    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:56.163306 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.163277    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:56.369581 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.369550    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"]
Sep 11 21:16:56.369895 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:16:56.369873    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c16cd9_7992_4534_aaa3_485e86dc286f.slice/crio-0170b44ca6975d7321e72a3cb3a1b74eecfea57ca96d2044209ebed285fbc448 WatchSource:0}: Error finding container 0170b44ca6975d7321e72a3cb3a1b74eecfea57ca96d2044209ebed285fbc448: Status 404 returned error can't find the container with id 0170b44ca6975d7321e72a3cb3a1b74eecfea57ca96d2044209ebed285fbc448
Sep 11 21:16:56.482265 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.482205    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" event={"ID":"a5c16cd9-7992-4534-aaa3-485e86dc286f","Type":"ContainerStarted","Data":"0170b44ca6975d7321e72a3cb3a1b74eecfea57ca96d2044209ebed285fbc448"}
Sep 11 21:16:56.483871 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.483848    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q" event={"ID":"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e","Type":"ContainerStarted","Data":"47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c"}
Sep 11 21:16:56.484118 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.484101    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:16:56.506793 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.506750    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q" podStartSLOduration=2.181976862 podStartE2EDuration="3.506737593s" totalImagesPullingTime="1.324760731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:56.505204456 +0000 UTC m=+685.096717796" watchObservedRunningTime="2026-09-11 21:16:56.506737593 +0000 UTC m=+685.098250915"
Sep 11 21:16:56.509687 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.509664    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:56.759387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:56.759304    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:57.072390 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.072355    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:57.291370 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.291337    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:57.405403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.405328    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:57.491723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.491683    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" event={"ID":"a5c16cd9-7992-4534-aaa3-485e86dc286f","Type":"ContainerStarted","Data":"2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e"}
Sep 11 21:16:57.492163 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.491964    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:16:57.542226 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.542185    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" podStartSLOduration=2.053001861 podStartE2EDuration="2.542162136s" totalImagesPullingTime="489.160275ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:16:57.53858199 +0000 UTC m=+686.130095313" watchObservedRunningTime="2026-09-11 21:16:57.542162136 +0000 UTC m=+686.133675459"
Sep 11 21:16:57.582266 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.582235    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:57.686402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.686322    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:57.945650 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:57.945555    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:58.306421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:58.306382    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:58.406711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:58.406675    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:16:59.881842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:16:59.881808    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:00.642534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:00.642478    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:00.732806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:00.732771    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:01.490272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:01.490237    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:17:01.490770 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:01.490743    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:17:01.644087 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:01.644057    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:02.752355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:02.752322    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:03.503284 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:03.503258    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:17:03.715672 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:03.715624    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:04.053687 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.053631    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:04.151059 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.151023    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:04.683762 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.683729    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"]
Sep 11 21:17:04.688203 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.688183    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.691022 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.691001    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-765a18-serving-cert\""
Sep 11 21:17:04.700925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.700903    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"]
Sep 11 21:17:04.731200 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.731169    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:04.770171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.770149    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-metrics-certs\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.770312 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.770200    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.770312 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.770276    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdcnj\" (UniqueName: \"kubernetes.io/projected/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-kube-api-access-wdcnj\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.770401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.770340    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-openshift-service-ca\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.830834 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.830805    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:04.871788 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.871758    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-openshift-service-ca\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.871925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.871808    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-metrics-certs\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.871925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.871864    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.871925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.871909    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdcnj\" (UniqueName: \"kubernetes.io/projected/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-kube-api-access-wdcnj\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.872087 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:04.871989    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-765a18-serving-cert: secret "maas-api-e2e-autores-765a18-serving-cert" not found
Sep 11 21:17:04.872087 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:04.872072    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls podName:ec0d4ee7-77ec-4ea7-b097-e510a831fed1 nodeName:}" failed. No retries permitted until 2026-09-11 21:17:05.372054486 +0000 UTC m=+693.963567801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls") pod "maas-api-e2e-autores-765a18-86b797c5fc-ngclt" (UID: "ec0d4ee7-77ec-4ea7-b097-e510a831fed1") : secret "maas-api-e2e-autores-765a18-serving-cert" not found
Sep 11 21:17:04.872488 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.872470    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-openshift-service-ca\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.874337 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.874320    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-metrics-certs\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.883592 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.883574    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdcnj\" (UniqueName: \"kubernetes.io/projected/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-kube-api-access-wdcnj\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:04.979667 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:04.979595    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:05.377227 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:05.377193    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:05.379861 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:05.379834    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls\") pod \"maas-api-e2e-autores-765a18-86b797c5fc-ngclt\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:05.537254 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:05.537216    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:05.601215 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:05.601189    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:05.641840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:05.641339    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:05.879700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:05.879675    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"]
Sep 11 21:17:05.881402 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:17:05.881369    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0d4ee7_77ec_4ea7_b097_e510a831fed1.slice/crio-a6986952f89a26cdbbb99ddef760db7b5569c3f01db69c93d7cf688bc181382c WatchSource:0}: Error finding container a6986952f89a26cdbbb99ddef760db7b5569c3f01db69c93d7cf688bc181382c: Status 404 returned error can't find the container with id a6986952f89a26cdbbb99ddef760db7b5569c3f01db69c93d7cf688bc181382c
Sep 11 21:17:06.108572 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.108542    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:06.285122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.285091    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:06.549498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.549469    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt" event={"ID":"ec0d4ee7-77ec-4ea7-b097-e510a831fed1","Type":"ContainerStarted","Data":"4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83"}
Sep 11 21:17:06.549918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.549517    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt" event={"ID":"ec0d4ee7-77ec-4ea7-b097-e510a831fed1","Type":"ContainerStarted","Data":"a6986952f89a26cdbbb99ddef760db7b5569c3f01db69c93d7cf688bc181382c"}
Sep 11 21:17:06.549918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.549551    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:06.570099 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.570056    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt" podStartSLOduration=2.279098225 podStartE2EDuration="2.57004222s" totalImagesPullingTime="290.943995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:06.567298669 +0000 UTC m=+695.158811994" watchObservedRunningTime="2026-09-11 21:17:06.57004222 +0000 UTC m=+695.161555602"
Sep 11 21:17:06.616976 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.616941    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:06.919671 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:06.919561    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:07.015489 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:07.015460    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:07.127766 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:07.127733    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:07.257844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:07.257776    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:07.403060 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:07.403025    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:07.493385 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:07.493356    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:17:08.149780 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.149748    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"]
Sep 11 21:17:08.153529 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.153505    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.156986 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.156964    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8dbad4ec-serving-cert\""
Sep 11 21:17:08.167374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.167352    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"]
Sep 11 21:17:08.202621 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.202599    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-metrics-certs\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.202758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.202630    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.202844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.202810    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzntm\" (UniqueName: \"kubernetes.io/projected/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-kube-api-access-pzntm\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.202899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.202872    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-openshift-service-ca\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.204235 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.204194    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:08.303927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.303901    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.304092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.303986    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzntm\" (UniqueName: \"kubernetes.io/projected/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-kube-api-access-pzntm\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.304092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.304014    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-openshift-service-ca\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.304092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.304041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-metrics-certs\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.304092 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:08.304067    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-serving-cert: secret "maas-api-e2e-ait-8dbad4ec-serving-cert" not found
Sep 11 21:17:08.304303 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:08.304141    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls podName:97a2104d-c917-4cbc-a39b-ea4b8c294c7a nodeName:}" failed. No retries permitted until 2026-09-11 21:17:08.804120947 +0000 UTC m=+697.395634270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls") pod "maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" (UID: "97a2104d-c917-4cbc-a39b-ea4b8c294c7a") : secret "maas-api-e2e-ait-8dbad4ec-serving-cert" not found
Sep 11 21:17:08.304691 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.304673    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-openshift-service-ca\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.306383 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.306362    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-metrics-certs\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.308364 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.308337    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:08.313297 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.313277    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzntm\" (UniqueName: \"kubernetes.io/projected/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-kube-api-access-pzntm\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.462375 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.462303    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:08.701737 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.701697    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:08.805730 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.805700    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:08.807808 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.807782    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:08.810217 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:08.810197    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls\") pod \"maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:09.065670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:09.065565    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:09.279836 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:09.279799    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:09.343385 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:09.343352    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"]
Sep 11 21:17:09.344269 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:17:09.344234    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97a2104d_c917_4cbc_a39b_ea4b8c294c7a.slice/crio-f067b284ec70f0285b94e4d931ae379075ba7e6ae65e8f64c82860dd9197ee83 WatchSource:0}: Error finding container f067b284ec70f0285b94e4d931ae379075ba7e6ae65e8f64c82860dd9197ee83: Status 404 returned error can't find the container with id f067b284ec70f0285b94e4d931ae379075ba7e6ae65e8f64c82860dd9197ee83
Sep 11 21:17:09.569148 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:09.569108    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" event={"ID":"97a2104d-c917-4cbc-a39b-ea4b8c294c7a","Type":"ContainerStarted","Data":"f067b284ec70f0285b94e4d931ae379075ba7e6ae65e8f64c82860dd9197ee83"}
Sep 11 21:17:09.978852 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:09.978760    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:10.187161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.187131    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:10.288612 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.288577    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:10.388789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.388756    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:10.576377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.576285    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" event={"ID":"97a2104d-c917-4cbc-a39b-ea4b8c294c7a","Type":"ContainerStarted","Data":"032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711"}
Sep 11 21:17:10.576377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.576365    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:10.595341 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.595281    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" podStartSLOduration=2.313546316 podStartE2EDuration="2.595267068s" totalImagesPullingTime="281.720752ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:10.593351114 +0000 UTC m=+699.184864438" watchObservedRunningTime="2026-09-11 21:17:10.595267068 +0000 UTC m=+699.186780391"
Sep 11 21:17:10.856140 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.856050    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:10.954899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:10.954864    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:11.250541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:11.250448    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:11.375499 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:11.375468    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:11.472251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:11.472208    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:11.845745 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:11.845707    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:11.995352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:11.995311    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:12.130096 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:12.130012    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:12.233218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:12.233182    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:12.561097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:12.561068    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:17:13.055514 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:13.055464    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:13.776478 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:13.776433    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:14.495562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.495530    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"]
Sep 11 21:17:14.499496 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.499474    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.502156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.502137    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2b95f8-serving-cert\""
Sep 11 21:17:14.513343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.513316    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"]
Sep 11 21:17:14.539880 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.539858    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:14.553634 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.553612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-maas-api-tls\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.553779 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.553762    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfms\" (UniqueName: \"kubernetes.io/projected/b18183f7-0d41-417b-9e0c-0ac33b79590d-kube-api-access-9wfms\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.553831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.553800    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18183f7-0d41-417b-9e0c-0ac33b79590d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.553831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.553825    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-metrics-certs\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.641304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.641268    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:14.654866 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.654830    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-maas-api-tls\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.654987 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.654934    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfms\" (UniqueName: \"kubernetes.io/projected/b18183f7-0d41-417b-9e0c-0ac33b79590d-kube-api-access-9wfms\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.654987 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.654962    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18183f7-0d41-417b-9e0c-0ac33b79590d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.654987 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.654983    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-metrics-certs\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.655592 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.655568    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18183f7-0d41-417b-9e0c-0ac33b79590d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.657225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.657205    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-metrics-certs\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.657328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.657248    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-maas-api-tls\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.664448 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.664426    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfms\" (UniqueName: \"kubernetes.io/projected/b18183f7-0d41-417b-9e0c-0ac33b79590d-kube-api-access-9wfms\") pod \"maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:14.742012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.741983    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:14.813435 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:14.813411    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:15.039336 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.039304    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:15.088230 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.088207    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"]
Sep 11 21:17:15.089651 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:17:15.089612    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18183f7_0d41_417b_9e0c_0ac33b79590d.slice/crio-26b8ce576f70783e18ab9759529ad42bd83c59bd98d9e86a23fb7cbd876c3030 WatchSource:0}: Error finding container 26b8ce576f70783e18ab9759529ad42bd83c59bd98d9e86a23fb7cbd876c3030: Status 404 returned error can't find the container with id 26b8ce576f70783e18ab9759529ad42bd83c59bd98d9e86a23fb7cbd876c3030
Sep 11 21:17:15.167767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.167740    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:15.565271 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.565239    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:15.612182 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.612145    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl" event={"ID":"b18183f7-0d41-417b-9e0c-0ac33b79590d","Type":"ContainerStarted","Data":"ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8"}
Sep 11 21:17:15.612297 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.612198    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl" event={"ID":"b18183f7-0d41-417b-9e0c-0ac33b79590d","Type":"ContainerStarted","Data":"26b8ce576f70783e18ab9759529ad42bd83c59bd98d9e86a23fb7cbd876c3030"}
Sep 11 21:17:15.612362 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.612295    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:15.630569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:15.630454    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl" podStartSLOduration=1.177074058 podStartE2EDuration="1.630435588s" totalImagesPullingTime="453.36153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:15.629149652 +0000 UTC m=+704.220662974" watchObservedRunningTime="2026-09-11 21:17:15.630435588 +0000 UTC m=+704.221948922"
Sep 11 21:17:16.510387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:16.510352    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:16.588147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:16.588122    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:17.299656 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:17.299609    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:18.198822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:18.198785    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:18.985999 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:18.985950    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:19.693713 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:19.693678    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:21.627065 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:21.627025    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:17:21.678160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:21.678128    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:21.761031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:21.760998    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:21.880351 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:21.880264    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:26.181717 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:26.181625    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:27.573927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:27.573889    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:28.304087 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:28.304055    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:28.417728 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:28.417695    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:28.507337 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:28.507304    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:28.767981 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:28.767888    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:29.559276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:29.559239    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:30.461163 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:30.461125    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:30.611395 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:30.611365    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:31.354895 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:31.354855    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:32.132704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:32.132661    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:33.092635 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:33.092600    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:33.908932 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:33.908882    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:34.805503 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:34.805425    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:35.542410 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:35.542370    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:35.642364 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:35.642330    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:35.743400 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:35.743364    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:36.514581 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:36.514548    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:37.469597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:37.469560    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:38.230229 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:38.230193    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:39.090509 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:39.090476    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:39.802324 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:39.802293    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:40.612650 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:40.612610    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:45.385544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:45.385492    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:45.992364 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:45.992326    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"]
Sep 11 21:17:45.992684 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:45.992621    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" podUID="97a2104d-c917-4cbc-a39b-ea4b8c294c7a" containerName="maas-api" containerID="cri-o://032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711" gracePeriod=30
Sep 11 21:17:46.021891 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.021861    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.094978 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.094931    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.159337 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.159299    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.248304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.248230    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.252147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.252121    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:46.324113 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.324077    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.361732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.359178    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls\") pod \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") "
Sep 11 21:17:46.361732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.359286    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzntm\" (UniqueName: \"kubernetes.io/projected/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-kube-api-access-pzntm\") pod \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") "
Sep 11 21:17:46.361732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.359348    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-metrics-certs\") pod \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") "
Sep 11 21:17:46.361732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.359400    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-openshift-service-ca\") pod \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\" (UID: \"97a2104d-c917-4cbc-a39b-ea4b8c294c7a\") "
Sep 11 21:17:46.361732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.360260    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "97a2104d-c917-4cbc-a39b-ea4b8c294c7a" (UID: "97a2104d-c917-4cbc-a39b-ea4b8c294c7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:17:46.366020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.365591    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "97a2104d-c917-4cbc-a39b-ea4b8c294c7a" (UID: "97a2104d-c917-4cbc-a39b-ea4b8c294c7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:17:46.366020 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.365918    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "97a2104d-c917-4cbc-a39b-ea4b8c294c7a" (UID: "97a2104d-c917-4cbc-a39b-ea4b8c294c7a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:17:46.380795 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.380745    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-kube-api-access-pzntm" (OuterVolumeSpecName: "kube-api-access-pzntm") pod "97a2104d-c917-4cbc-a39b-ea4b8c294c7a" (UID: "97a2104d-c917-4cbc-a39b-ea4b8c294c7a"). InnerVolumeSpecName "kube-api-access-pzntm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:17:46.399415 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.399383    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.461341 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.461317    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:17:46.461341 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.461341    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:17:46.461527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.461352    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzntm\" (UniqueName: \"kubernetes.io/projected/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-kube-api-access-pzntm\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:17:46.461527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.461361    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/97a2104d-c917-4cbc-a39b-ea4b8c294c7a-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:17:46.560323 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.560287    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.800092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.800061    2585 generic.go:356] "Generic (PLEG): container finished" podID="97a2104d-c917-4cbc-a39b-ea4b8c294c7a" containerID="032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711" exitCode=0
Sep 11 21:17:46.800285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.800106    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"
Sep 11 21:17:46.800285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.800145    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" event={"ID":"97a2104d-c917-4cbc-a39b-ea4b8c294c7a","Type":"ContainerDied","Data":"032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711"}
Sep 11 21:17:46.800285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.800205    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6" event={"ID":"97a2104d-c917-4cbc-a39b-ea4b8c294c7a","Type":"ContainerDied","Data":"f067b284ec70f0285b94e4d931ae379075ba7e6ae65e8f64c82860dd9197ee83"}
Sep 11 21:17:46.800285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.800233    2585 scope.go:117] "RemoveContainer" containerID="032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711"
Sep 11 21:17:46.810885 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.810865    2585 scope.go:117] "RemoveContainer" containerID="032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711"
Sep 11 21:17:46.811206 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:46.811190    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711\": container with ID starting with 032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711 not found: ID does not exist" containerID="032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711"
Sep 11 21:17:46.811270 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.811217    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711"} err="failed to get container status \"032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711\": rpc error: code = NotFound desc = could not find container \"032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711\": container with ID starting with 032de7318231d4d52ad2f66d804bde8ffff16803a20b3f42fc30a8bb9f863711 not found: ID does not exist"
Sep 11 21:17:46.834317 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.834285    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"]
Sep 11 21:17:46.845805 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.845780    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8dbad4ec-5455b696df-c8cl6"]
Sep 11 21:17:46.861700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.861660    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:46.941578 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:46.941539    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:47.077115 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:47.077021    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:47.766796 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:47.766752    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:47.888220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:47.888186    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97a2104d-c917-4cbc-a39b-ea4b8c294c7a" path="/var/lib/kubelet/pods/97a2104d-c917-4cbc-a39b-ea4b8c294c7a/volumes"
Sep 11 21:17:47.917528 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:47.917491    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:48.747800 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:48.747765    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:49.689093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:49.689058    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:50.374396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:50.374366    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:50.485513 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:50.485478    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:50.582362 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:50.582331    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:51.712569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:51.712533    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:52.673534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.673497    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"]
Sep 11 21:17:52.674260 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.674232    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97a2104d-c917-4cbc-a39b-ea4b8c294c7a" containerName="maas-api"
Sep 11 21:17:52.674260 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.674260    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="97a2104d-c917-4cbc-a39b-ea4b8c294c7a" containerName="maas-api"
Sep 11 21:17:52.674448 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.674398    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="97a2104d-c917-4cbc-a39b-ea4b8c294c7a" containerName="maas-api"
Sep 11 21:17:52.679422 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.679401    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.681823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.681803    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2d3d3219-serving-cert\""
Sep 11 21:17:52.692498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.692470    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"]
Sep 11 21:17:52.715797 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.715768    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:52.718680 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.718659    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.718791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.718701    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-metrics-certs\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.718791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.718768    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dn56\" (UniqueName: \"kubernetes.io/projected/3b506863-e778-4ab3-b97e-8a6cc42de98e-kube-api-access-8dn56\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.718911 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.718810    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b506863-e778-4ab3-b97e-8a6cc42de98e-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.799255 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.799224    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:52.819421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.819381    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.819551 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.819437    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-metrics-certs\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.819551 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:52.819537    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-serving-cert: secret "maas-api-e2e-migrate-2d3d3219-serving-cert" not found
Sep 11 21:17:52.819716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.819551    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dn56\" (UniqueName: \"kubernetes.io/projected/3b506863-e778-4ab3-b97e-8a6cc42de98e-kube-api-access-8dn56\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.819716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.819585    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b506863-e778-4ab3-b97e-8a6cc42de98e-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.819716 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:17:52.819609    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls podName:3b506863-e778-4ab3-b97e-8a6cc42de98e nodeName:}" failed. No retries permitted until 2026-09-11 21:17:53.319588219 +0000 UTC m=+741.911101534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls") pod "maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" (UID: "3b506863-e778-4ab3-b97e-8a6cc42de98e") : secret "maas-api-e2e-migrate-2d3d3219-serving-cert" not found
Sep 11 21:17:52.820149 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.820132    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b506863-e778-4ab3-b97e-8a6cc42de98e-openshift-service-ca\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.821758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.821738    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-metrics-certs\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:52.832279 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:52.832255    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dn56\" (UniqueName: \"kubernetes.io/projected/3b506863-e778-4ab3-b97e-8a6cc42de98e-kube-api-access-8dn56\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:53.170737 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.170703    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:53.316342 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.316313    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:53.324572 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.324544    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:53.326711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.326692    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls\") pod \"maas-api-e2e-migrate-2d3d3219-566796845-qxnd7\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:53.414381 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.414349    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:53.592770 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.592736    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:53.818274 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.818234    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:53.883170 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:17:53.883141    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b506863_e778_4ab3_b97e_8a6cc42de98e.slice/crio-13e0b06b3e36f89bffd7aa937e8ab794ddbe37fa1c23d3355d1040f6b1478494 WatchSource:0}: Error finding container 13e0b06b3e36f89bffd7aa937e8ab794ddbe37fa1c23d3355d1040f6b1478494: Status 404 returned error can't find the container with id 13e0b06b3e36f89bffd7aa937e8ab794ddbe37fa1c23d3355d1040f6b1478494
Sep 11 21:17:53.888781 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:53.888761    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"]
Sep 11 21:17:54.656926 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:54.656882    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:54.851743 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:54.851696    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" event={"ID":"3b506863-e778-4ab3-b97e-8a6cc42de98e","Type":"ContainerStarted","Data":"977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081"}
Sep 11 21:17:54.852129 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:54.851788    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" event={"ID":"3b506863-e778-4ab3-b97e-8a6cc42de98e","Type":"ContainerStarted","Data":"13e0b06b3e36f89bffd7aa937e8ab794ddbe37fa1c23d3355d1040f6b1478494"}
Sep 11 21:17:54.852129 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:54.851914    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:17:54.875990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:54.875944    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" podStartSLOduration=2.546720349 podStartE2EDuration="2.875930719s" totalImagesPullingTime="329.21037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:17:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:17:54.873756944 +0000 UTC m=+743.465270278" watchObservedRunningTime="2026-09-11 21:17:54.875930719 +0000 UTC m=+743.467444042"
Sep 11 21:17:55.364704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:55.364630    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:17:56.077630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:17:56.077594    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:00.863806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:00.863773    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:18:14.988835 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:14.988800    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:16.020944 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:16.020902    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:16.715852 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:16.715816    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:17.439694 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:17.439661    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:18.303411 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:18.303376    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:19.144681 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:19.144647    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:19.856272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:19.856243    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:20.615438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:20.615406    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.240618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.240588    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"]
Sep 11 21:18:21.240880 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.240793    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" podUID="3b506863-e778-4ab3-b97e-8a6cc42de98e" containerName="maas-api" containerID="cri-o://977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081" gracePeriod=30
Sep 11 21:18:21.268023 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.267996    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.364724 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.364693    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.464361 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.464329    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.508032 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.508010    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:18:21.568574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.568536    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.665910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.665880    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:21.683662 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.683615    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dn56\" (UniqueName: \"kubernetes.io/projected/3b506863-e778-4ab3-b97e-8a6cc42de98e-kube-api-access-8dn56\") pod \"3b506863-e778-4ab3-b97e-8a6cc42de98e\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") "
Sep 11 21:18:21.683776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.683702    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b506863-e778-4ab3-b97e-8a6cc42de98e-openshift-service-ca\") pod \"3b506863-e778-4ab3-b97e-8a6cc42de98e\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") "
Sep 11 21:18:21.683776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.683735    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls\") pod \"3b506863-e778-4ab3-b97e-8a6cc42de98e\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") "
Sep 11 21:18:21.683865 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.683793    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-metrics-certs\") pod \"3b506863-e778-4ab3-b97e-8a6cc42de98e\" (UID: \"3b506863-e778-4ab3-b97e-8a6cc42de98e\") "
Sep 11 21:18:21.684069 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.684042    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b506863-e778-4ab3-b97e-8a6cc42de98e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b506863-e778-4ab3-b97e-8a6cc42de98e" (UID: "3b506863-e778-4ab3-b97e-8a6cc42de98e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:21.685632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.685605    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b506863-e778-4ab3-b97e-8a6cc42de98e-kube-api-access-8dn56" (OuterVolumeSpecName: "kube-api-access-8dn56") pod "3b506863-e778-4ab3-b97e-8a6cc42de98e" (UID: "3b506863-e778-4ab3-b97e-8a6cc42de98e"). InnerVolumeSpecName "kube-api-access-8dn56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:21.685632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.685680    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b506863-e778-4ab3-b97e-8a6cc42de98e" (UID: "3b506863-e778-4ab3-b97e-8a6cc42de98e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:18:21.685870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.685853    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3b506863-e778-4ab3-b97e-8a6cc42de98e" (UID: "3b506863-e778-4ab3-b97e-8a6cc42de98e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:18:21.784941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.784911    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dn56\" (UniqueName: \"kubernetes.io/projected/3b506863-e778-4ab3-b97e-8a6cc42de98e-kube-api-access-8dn56\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:21.784941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.784935    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b506863-e778-4ab3-b97e-8a6cc42de98e-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:21.784941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.784946    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:21.785194 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.784955    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b506863-e778-4ab3-b97e-8a6cc42de98e-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:21.919546 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:21.919499    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.013272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.013235    2585 generic.go:356] "Generic (PLEG): container finished" podID="3b506863-e778-4ab3-b97e-8a6cc42de98e" containerID="977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081" exitCode=0
Sep 11 21:18:22.013434 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.013292    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"
Sep 11 21:18:22.013434 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.013325    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" event={"ID":"3b506863-e778-4ab3-b97e-8a6cc42de98e","Type":"ContainerDied","Data":"977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081"}
Sep 11 21:18:22.013434 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.013382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7" event={"ID":"3b506863-e778-4ab3-b97e-8a6cc42de98e","Type":"ContainerDied","Data":"13e0b06b3e36f89bffd7aa937e8ab794ddbe37fa1c23d3355d1040f6b1478494"}
Sep 11 21:18:22.013434 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.013406    2585 scope.go:117] "RemoveContainer" containerID="977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081"
Sep 11 21:18:22.025452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.025436    2585 scope.go:117] "RemoveContainer" containerID="977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081"
Sep 11 21:18:22.025748 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:18:22.025728    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081\": container with ID starting with 977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081 not found: ID does not exist" containerID="977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081"
Sep 11 21:18:22.025845 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.025757    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081"} err="failed to get container status \"977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081\": rpc error: code = NotFound desc = could not find container \"977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081\": container with ID starting with 977253b77fac6a3d16e6f13dda1b42815f3a3847dabad7216c7991f750cac081 not found: ID does not exist"
Sep 11 21:18:22.030436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.030416    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"]
Sep 11 21:18:22.034354 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.034334    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2d3d3219-566796845-qxnd7"]
Sep 11 21:18:22.080161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.080101    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.438978 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.438904    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.571762 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.571718    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:22.865822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:22.865785    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.849359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:23.849320    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:23.887182 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:23.887156    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b506863-e778-4ab3-b97e-8a6cc42de98e" path="/var/lib/kubelet/pods/3b506863-e778-4ab3-b97e-8a6cc42de98e/volumes"
Sep 11 21:18:24.539254 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:24.539219    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:24.669120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:24.669087    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:24.854857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:24.854782    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:25.584345 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:25.584312    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:26.488457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:26.488415    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:27.179143 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.179109    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"]
Sep 11 21:18:27.179847 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.179827    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b506863-e778-4ab3-b97e-8a6cc42de98e" containerName="maas-api"
Sep 11 21:18:27.179912 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.179850    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b506863-e778-4ab3-b97e-8a6cc42de98e" containerName="maas-api"
Sep 11 21:18:27.179998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.179987    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b506863-e778-4ab3-b97e-8a6cc42de98e" containerName="maas-api"
Sep 11 21:18:27.183736 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.183714    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.186131 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.186111    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-257d9182-serving-cert\""
Sep 11 21:18:27.193324 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.193299    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"]
Sep 11 21:18:27.213002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.212979    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:27.228954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.228932    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.229052 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.228964    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ef109c-ed11-486c-87f3-e68e60d101b0-openshift-service-ca\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.229052 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.229006    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdn7v\" (UniqueName: \"kubernetes.io/projected/77ef109c-ed11-486c-87f3-e68e60d101b0-kube-api-access-pdn7v\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.229052 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.229024    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-metrics-certs\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.310204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.310153    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:27.330518 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.330493    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.330625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.330526    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ef109c-ed11-486c-87f3-e68e60d101b0-openshift-service-ca\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.330625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.330575    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdn7v\" (UniqueName: \"kubernetes.io/projected/77ef109c-ed11-486c-87f3-e68e60d101b0-kube-api-access-pdn7v\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.330625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.330600    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-metrics-certs\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.330794 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:18:27.330662    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-serving-cert: secret "maas-api-e2e-ait-257d9182-serving-cert" not found
Sep 11 21:18:27.330794 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:18:27.330731    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls podName:77ef109c-ed11-486c-87f3-e68e60d101b0 nodeName:}" failed. No retries permitted until 2026-09-11 21:18:27.830712365 +0000 UTC m=+776.422225675 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls") pod "maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" (UID: "77ef109c-ed11-486c-87f3-e68e60d101b0") : secret "maas-api-e2e-ait-257d9182-serving-cert" not found
Sep 11 21:18:27.331152 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.331134    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ef109c-ed11-486c-87f3-e68e60d101b0-openshift-service-ca\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.333056 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.333036    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-metrics-certs\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.339501 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.339479    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdn7v\" (UniqueName: \"kubernetes.io/projected/77ef109c-ed11-486c-87f3-e68e60d101b0-kube-api-access-pdn7v\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.627463 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.627423    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:27.724565 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.724536    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:27.803362 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.803336    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:27.835537 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.835509    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:27.838111 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:27.838089    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls\") pod \"maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:28.097352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:28.097313    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:28.187961 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:28.187931    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:28.379818 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:28.379791    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"]
Sep 11 21:18:28.381020 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:18:28.380986    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ef109c_ed11_486c_87f3_e68e60d101b0.slice/crio-f01fbabc5a1a36624272d4b100116321751776c32af6d6a3753b51c4b8e81794 WatchSource:0}: Error finding container f01fbabc5a1a36624272d4b100116321751776c32af6d6a3753b51c4b8e81794: Status 404 returned error can't find the container with id f01fbabc5a1a36624272d4b100116321751776c32af6d6a3753b51c4b8e81794
Sep 11 21:18:28.900217 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:28.900174    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:29.057471 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:29.057438    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" event={"ID":"77ef109c-ed11-486c-87f3-e68e60d101b0","Type":"ContainerStarted","Data":"3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf"}
Sep 11 21:18:29.057655 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:29.057499    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" event={"ID":"77ef109c-ed11-486c-87f3-e68e60d101b0","Type":"ContainerStarted","Data":"f01fbabc5a1a36624272d4b100116321751776c32af6d6a3753b51c4b8e81794"}
Sep 11 21:18:29.057655 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:29.057528    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:29.080010 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:29.079927    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" podStartSLOduration=1.6333177330000002 podStartE2EDuration="2.079914029s" totalImagesPullingTime="446.596296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:18:29.077073641 +0000 UTC m=+777.668586964" watchObservedRunningTime="2026-09-11 21:18:29.079914029 +0000 UTC m=+777.671427352"
Sep 11 21:18:29.630911 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:29.630877    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:35.069290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:35.069248    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:41.212877 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:41.212843    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:42.363454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:42.363413    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:42.463037 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:42.462999    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:49.380469 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:49.380430    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:50.105402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:50.105363    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:51.147831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:51.147789    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:52.123574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:52.123537    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:53.030282 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:53.030240    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:53.981145 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:53.981110    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:54.788276 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:54.788240    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:55.726180 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:55.726134    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:56.567562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:56.567532    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:57.225669 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.225623    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"]
Sep 11 21:18:57.225859 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.225835    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" podUID="77ef109c-ed11-486c-87f3-e68e60d101b0" containerName="maas-api" containerID="cri-o://3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf" gracePeriod=30
Sep 11 21:18:57.239301 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.239267    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:57.341012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.340979    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:57.439823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.439790    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:57.487500 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.487430    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:57.519904 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.519870    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:57.604017 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.603986    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-metrics-certs\") pod \"77ef109c-ed11-486c-87f3-e68e60d101b0\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") "
Sep 11 21:18:57.604479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.604039    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdn7v\" (UniqueName: \"kubernetes.io/projected/77ef109c-ed11-486c-87f3-e68e60d101b0-kube-api-access-pdn7v\") pod \"77ef109c-ed11-486c-87f3-e68e60d101b0\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") "
Sep 11 21:18:57.604479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.604079    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ef109c-ed11-486c-87f3-e68e60d101b0-openshift-service-ca\") pod \"77ef109c-ed11-486c-87f3-e68e60d101b0\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") "
Sep 11 21:18:57.604479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.604138    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls\") pod \"77ef109c-ed11-486c-87f3-e68e60d101b0\" (UID: \"77ef109c-ed11-486c-87f3-e68e60d101b0\") "
Sep 11 21:18:57.604673 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.604518    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ef109c-ed11-486c-87f3-e68e60d101b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77ef109c-ed11-486c-87f3-e68e60d101b0" (UID: "77ef109c-ed11-486c-87f3-e68e60d101b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:18:57.606860 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.606832    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "77ef109c-ed11-486c-87f3-e68e60d101b0" (UID: "77ef109c-ed11-486c-87f3-e68e60d101b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:18:57.606968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.606840    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77ef109c-ed11-486c-87f3-e68e60d101b0" (UID: "77ef109c-ed11-486c-87f3-e68e60d101b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:18:57.606968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.606891    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77ef109c-ed11-486c-87f3-e68e60d101b0-kube-api-access-pdn7v" (OuterVolumeSpecName: "kube-api-access-pdn7v") pod "77ef109c-ed11-486c-87f3-e68e60d101b0" (UID: "77ef109c-ed11-486c-87f3-e68e60d101b0"). InnerVolumeSpecName "kube-api-access-pdn7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:18:57.705391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.705343    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:57.705391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.705376    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77ef109c-ed11-486c-87f3-e68e60d101b0-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:57.705391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.705390    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdn7v\" (UniqueName: \"kubernetes.io/projected/77ef109c-ed11-486c-87f3-e68e60d101b0-kube-api-access-pdn7v\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:57.705391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.705403    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ef109c-ed11-486c-87f3-e68e60d101b0-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:18:57.915899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:57.915864    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:58.251006 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.250920    2585 generic.go:356] "Generic (PLEG): container finished" podID="77ef109c-ed11-486c-87f3-e68e60d101b0" containerID="3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf" exitCode=0
Sep 11 21:18:58.251006 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.250970    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"
Sep 11 21:18:58.251216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.251004    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" event={"ID":"77ef109c-ed11-486c-87f3-e68e60d101b0","Type":"ContainerDied","Data":"3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf"}
Sep 11 21:18:58.251216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.251051    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6" event={"ID":"77ef109c-ed11-486c-87f3-e68e60d101b0","Type":"ContainerDied","Data":"f01fbabc5a1a36624272d4b100116321751776c32af6d6a3753b51c4b8e81794"}
Sep 11 21:18:58.251216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.251073    2585 scope.go:117] "RemoveContainer" containerID="3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf"
Sep 11 21:18:58.260583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.260563    2585 scope.go:117] "RemoveContainer" containerID="3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf"
Sep 11 21:18:58.260866 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:18:58.260846    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf\": container with ID starting with 3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf not found: ID does not exist" containerID="3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf"
Sep 11 21:18:58.260916 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.260876    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf"} err="failed to get container status \"3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf\": rpc error: code = NotFound desc = could not find container \"3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf\": container with ID starting with 3a99241106432e4f1cf19093b88873a7dabb3956076ce7a6cb3fcd51eaeb5ddf not found: ID does not exist"
Sep 11 21:18:58.269493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.269470    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"]
Sep 11 21:18:58.278374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.278347    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-257d9182-779bfcbfd4-xbwq6"]
Sep 11 21:18:58.673620 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.673587    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:58.813515 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:58.813480    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.135984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:59.135939    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.424807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:59.424699    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.589196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:59.589163    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:18:59.887218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:59.887189    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77ef109c-ed11-486c-87f3-e68e60d101b0" path="/var/lib/kubelet/pods/77ef109c-ed11-486c-87f3-e68e60d101b0/volumes"
Sep 11 21:18:59.896979 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:18:59.896954    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:00.890562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:00.890527    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:01.618661 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:01.618605    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:01.716347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:01.716315    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:01.816312 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:01.816281    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:03.033051 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.033008    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:03.932232 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.932201    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"]
Sep 11 21:19:03.932751 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.932722    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ef109c-ed11-486c-87f3-e68e60d101b0" containerName="maas-api"
Sep 11 21:19:03.932751 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.932740    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ef109c-ed11-486c-87f3-e68e60d101b0" containerName="maas-api"
Sep 11 21:19:03.932939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.932838    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ef109c-ed11-486c-87f3-e68e60d101b0" containerName="maas-api"
Sep 11 21:19:03.935939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.935916    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:03.938222 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.938203    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5fdb611f-serving-cert\""
Sep 11 21:19:03.947537 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.947147    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"]
Sep 11 21:19:03.965842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:03.965817    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:04.028191 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.028164    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:04.064273 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.064240    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1119bf-7021-4bca-ad7e-d31413f9c709-openshift-service-ca\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.064705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.064322    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.064705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.064358    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzkcb\" (UniqueName: \"kubernetes.io/projected/5e1119bf-7021-4bca-ad7e-d31413f9c709-kube-api-access-wzkcb\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.064705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.064386    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-metrics-certs\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.165760 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.165733    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.165888 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.165783    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzkcb\" (UniqueName: \"kubernetes.io/projected/5e1119bf-7021-4bca-ad7e-d31413f9c709-kube-api-access-wzkcb\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.165888 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.165819    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-metrics-certs\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.165888 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.165849    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1119bf-7021-4bca-ad7e-d31413f9c709-openshift-service-ca\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.165994 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:19:04.165883    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-serving-cert: secret "maas-api-e2e-derive-5fdb611f-serving-cert" not found
Sep 11 21:19:04.165994 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:19:04.165959    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls podName:5e1119bf-7021-4bca-ad7e-d31413f9c709 nodeName:}" failed. No retries permitted until 2026-09-11 21:19:04.665940442 +0000 UTC m=+813.257453747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls") pod "maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" (UID: "5e1119bf-7021-4bca-ad7e-d31413f9c709") : secret "maas-api-e2e-derive-5fdb611f-serving-cert" not found
Sep 11 21:19:04.166539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.166517    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1119bf-7021-4bca-ad7e-d31413f9c709-openshift-service-ca\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.168220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.168203    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-metrics-certs\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.174592 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.174572    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzkcb\" (UniqueName: \"kubernetes.io/projected/5e1119bf-7021-4bca-ad7e-d31413f9c709-kube-api-access-wzkcb\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.462555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.462521    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:04.564099 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.564073    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:04.666318 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.666278    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:04.671605 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.671129    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.674917 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.674893    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls\") pod \"maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.851609 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.851582    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:04.903661 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:04.903596    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:05.127327 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:05.127297    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"]
Sep 11 21:19:05.129284 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:19:05.129244    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e1119bf_7021_4bca_ad7e_d31413f9c709.slice/crio-33bced520b6c7f695dfbfd58f28d951d04c5670e3bf3f2bd16266a5f3bf9f115 WatchSource:0}: Error finding container 33bced520b6c7f695dfbfd58f28d951d04c5670e3bf3f2bd16266a5f3bf9f115: Status 404 returned error can't find the container with id 33bced520b6c7f695dfbfd58f28d951d04c5670e3bf3f2bd16266a5f3bf9f115
Sep 11 21:19:05.294963 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:05.294931    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" event={"ID":"5e1119bf-7021-4bca-ad7e-d31413f9c709","Type":"ContainerStarted","Data":"33bced520b6c7f695dfbfd58f28d951d04c5670e3bf3f2bd16266a5f3bf9f115"}
Sep 11 21:19:05.632388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:05.632361    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:06.302541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:06.302502    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" event={"ID":"5e1119bf-7021-4bca-ad7e-d31413f9c709","Type":"ContainerStarted","Data":"7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe"}
Sep 11 21:19:06.302974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:06.302600    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:06.319049 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:06.318995    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" podStartSLOduration=2.925371764 podStartE2EDuration="3.318979572s" totalImagesPullingTime="393.607808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:19:06.318316688 +0000 UTC m=+814.909830011" watchObservedRunningTime="2026-09-11 21:19:06.318979572 +0000 UTC m=+814.910492895"
Sep 11 21:19:06.334693 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:06.334666    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:06.995702 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:06.995666    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:07.701967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:07.701924    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:12.313996 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:12.313966    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:25.011024 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:25.010991    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:26.290691 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:26.290634    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:27.220857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:27.220812    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:27.925662 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:27.925607    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:28.637482 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:28.637438    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:29.600782 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:29.600747    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:30.311959 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:30.311926    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:31.181007 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:31.180972    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:31.888579 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:31.888538    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:33.060584 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.060550    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:33.663514 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.663479    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"]
Sep 11 21:19:33.663792 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.663744    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" podUID="5e1119bf-7021-4bca-ad7e-d31413f9c709" containerName="maas-api" containerID="cri-o://7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe" gracePeriod=30
Sep 11 21:19:33.690971 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.690941    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:33.790725 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.790687    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:33.883253 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.883222    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:33.936047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.936024    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:33.948292 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:33.948257    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:34.024426 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.024385    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1119bf-7021-4bca-ad7e-d31413f9c709-openshift-service-ca\") pod \"5e1119bf-7021-4bca-ad7e-d31413f9c709\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") "
Sep 11 21:19:34.024617 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.024432    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-metrics-certs\") pod \"5e1119bf-7021-4bca-ad7e-d31413f9c709\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") "
Sep 11 21:19:34.024617 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.024517    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzkcb\" (UniqueName: \"kubernetes.io/projected/5e1119bf-7021-4bca-ad7e-d31413f9c709-kube-api-access-wzkcb\") pod \"5e1119bf-7021-4bca-ad7e-d31413f9c709\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") "
Sep 11 21:19:34.024617 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.024609    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls\") pod \"5e1119bf-7021-4bca-ad7e-d31413f9c709\" (UID: \"5e1119bf-7021-4bca-ad7e-d31413f9c709\") "
Sep 11 21:19:34.025879 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.025845    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e1119bf-7021-4bca-ad7e-d31413f9c709-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e1119bf-7021-4bca-ad7e-d31413f9c709" (UID: "5e1119bf-7021-4bca-ad7e-d31413f9c709"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:19:34.028892 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.028221    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e1119bf-7021-4bca-ad7e-d31413f9c709" (UID: "5e1119bf-7021-4bca-ad7e-d31413f9c709"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:34.029589 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.029555    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5e1119bf-7021-4bca-ad7e-d31413f9c709" (UID: "5e1119bf-7021-4bca-ad7e-d31413f9c709"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:19:34.031097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.031072    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e1119bf-7021-4bca-ad7e-d31413f9c709-kube-api-access-wzkcb" (OuterVolumeSpecName: "kube-api-access-wzkcb") pod "5e1119bf-7021-4bca-ad7e-d31413f9c709" (UID: "5e1119bf-7021-4bca-ad7e-d31413f9c709"). InnerVolumeSpecName "kube-api-access-wzkcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:19:34.043417 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.043388    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:34.125972 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.125942    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.125972 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.125970    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e1119bf-7021-4bca-ad7e-d31413f9c709-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.126389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.125984    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e1119bf-7021-4bca-ad7e-d31413f9c709-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.126389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.125998    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzkcb\" (UniqueName: \"kubernetes.io/projected/5e1119bf-7021-4bca-ad7e-d31413f9c709-kube-api-access-wzkcb\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:19:34.466583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.466547    2585 generic.go:356] "Generic (PLEG): container finished" podID="5e1119bf-7021-4bca-ad7e-d31413f9c709" containerID="7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe" exitCode=0
Sep 11 21:19:34.466802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.466591    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"
Sep 11 21:19:34.466802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.466633    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" event={"ID":"5e1119bf-7021-4bca-ad7e-d31413f9c709","Type":"ContainerDied","Data":"7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe"}
Sep 11 21:19:34.466802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.466709    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb" event={"ID":"5e1119bf-7021-4bca-ad7e-d31413f9c709","Type":"ContainerDied","Data":"33bced520b6c7f695dfbfd58f28d951d04c5670e3bf3f2bd16266a5f3bf9f115"}
Sep 11 21:19:34.466802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.466737    2585 scope.go:117] "RemoveContainer" containerID="7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe"
Sep 11 21:19:34.480432 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.480404    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:34.480723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.480704    2585 scope.go:117] "RemoveContainer" containerID="7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe"
Sep 11 21:19:34.481185 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:19:34.481166    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe\": container with ID starting with 7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe not found: ID does not exist" containerID="7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe"
Sep 11 21:19:34.481260 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.481190    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe"} err="failed to get container status \"7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe\": rpc error: code = NotFound desc = could not find container \"7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe\": container with ID starting with 7d3f4c6a66cad774beafe5817c2f986b82ad82ca23fea9ba01848cc972a1c9fe not found: ID does not exist"
Sep 11 21:19:34.509309 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.509288    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"]
Sep 11 21:19:34.516272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.516249    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5fdb611f-bf5f84684-q4zgb"]
Sep 11 21:19:34.746178 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.746104    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:34.953185 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:34.953157    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:35.567974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:35.567943    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:35.892844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:35.887816    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e1119bf-7021-4bca-ad7e-d31413f9c709" path="/var/lib/kubelet/pods/5e1119bf-7021-4bca-ad7e-d31413f9c709/volumes"
Sep 11 21:19:36.464795 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:36.464755    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:36.822543 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:36.822505    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:37.590445 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:37.590412    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:38.405859 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:38.405828    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:39.235174 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:39.235135    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:42.176850 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:42.176807    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:42.283042 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:42.283006    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:42.377275 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:42.377237    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:42.514572 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:42.514474    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:42.890199 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:42.890161    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:46.793370 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:46.793331    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:19:57.853104 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:19:57.853068    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:00.373311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:00.373277    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:01.185333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:01.185296    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:01.884227 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:01.884193    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:02.729377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:02.729343    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:03.436577 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:03.436544    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:04.282775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:04.282718    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:04.996811 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:04.996763    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:08.820697 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:08.820656    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:10.618695 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.618602    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"]
Sep 11 21:20:10.619704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.619612    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt" podUID="ec0d4ee7-77ec-4ea7-b097-e510a831fed1" containerName="maas-api" containerID="cri-o://4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83" gracePeriod=30
Sep 11 21:20:10.640313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.640235    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:10.736044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.736015    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:10.838972 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.838940    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:10.885244 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.885182    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:20:10.917186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.917127    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:10.962037 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.962011    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-metrics-certs\") pod \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") "
Sep 11 21:20:10.962224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.962054    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-openshift-service-ca\") pod \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") "
Sep 11 21:20:10.962224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.962125    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls\") pod \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") "
Sep 11 21:20:10.962224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.962166    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdcnj\" (UniqueName: \"kubernetes.io/projected/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-kube-api-access-wdcnj\") pod \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\" (UID: \"ec0d4ee7-77ec-4ea7-b097-e510a831fed1\") "
Sep 11 21:20:10.962921 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.962873    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec0d4ee7-77ec-4ea7-b097-e510a831fed1" (UID: "ec0d4ee7-77ec-4ea7-b097-e510a831fed1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:10.964552 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.964525    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec0d4ee7-77ec-4ea7-b097-e510a831fed1" (UID: "ec0d4ee7-77ec-4ea7-b097-e510a831fed1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:10.964871 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.964848    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ec0d4ee7-77ec-4ea7-b097-e510a831fed1" (UID: "ec0d4ee7-77ec-4ea7-b097-e510a831fed1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:10.964971 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:10.964931    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-kube-api-access-wdcnj" (OuterVolumeSpecName: "kube-api-access-wdcnj") pod "ec0d4ee7-77ec-4ea7-b097-e510a831fed1" (UID: "ec0d4ee7-77ec-4ea7-b097-e510a831fed1"). InnerVolumeSpecName "kube-api-access-wdcnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:11.063531 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.063492    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:11.063531 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.063522    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:11.063531 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.063536    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:11.063822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.063547    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdcnj\" (UniqueName: \"kubernetes.io/projected/ec0d4ee7-77ec-4ea7-b097-e510a831fed1-kube-api-access-wdcnj\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:11.182460 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.182364    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:11.282383 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.282348    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:11.693953 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.693921    2585 generic.go:356] "Generic (PLEG): container finished" podID="ec0d4ee7-77ec-4ea7-b097-e510a831fed1" containerID="4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83" exitCode=0
Sep 11 21:20:11.694381 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.693969    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"
Sep 11 21:20:11.694381 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.694007    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt" event={"ID":"ec0d4ee7-77ec-4ea7-b097-e510a831fed1","Type":"ContainerDied","Data":"4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83"}
Sep 11 21:20:11.694381 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.694066    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt" event={"ID":"ec0d4ee7-77ec-4ea7-b097-e510a831fed1","Type":"ContainerDied","Data":"a6986952f89a26cdbbb99ddef760db7b5569c3f01db69c93d7cf688bc181382c"}
Sep 11 21:20:11.694381 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.694094    2585 scope.go:117] "RemoveContainer" containerID="4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83"
Sep 11 21:20:11.704251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.704230    2585 scope.go:117] "RemoveContainer" containerID="4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83"
Sep 11 21:20:11.704514 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:20:11.704497    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83\": container with ID starting with 4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83 not found: ID does not exist" containerID="4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83"
Sep 11 21:20:11.704559 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.704521    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83"} err="failed to get container status \"4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83\": rpc error: code = NotFound desc = could not find container \"4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83\": container with ID starting with 4ed839363cd05958b4cb53f84303bccb5e827ce86f6c3f3203d95716f1ce7a83 not found: ID does not exist"
Sep 11 21:20:11.716567 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.716544    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"]
Sep 11 21:20:11.720744 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.720724    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-765a18-86b797c5fc-ngclt"]
Sep 11 21:20:11.888634 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:11.888603    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec0d4ee7-77ec-4ea7-b097-e510a831fed1" path="/var/lib/kubelet/pods/ec0d4ee7-77ec-4ea7-b097-e510a831fed1/volumes"
Sep 11 21:20:12.021509 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:12.021421    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:12.702115 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:12.702081    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:13.524789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:13.524746    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:14.218871 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:14.218829    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:14.860760 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:14.860731    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:14.977681 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:14.977652    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:15.065258 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:15.065221    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:16.261062 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:16.261031    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:17.687508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:17.687473    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:18.040490 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:18.040453    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:18.140557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:18.140515    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:19.101751 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:19.101711    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:19.859845 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:19.859809    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:20.607546 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:20.607509    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:21.401523 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:21.401491    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:22.115954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:22.115920    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:22.718137 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:22.718100    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:23.112148 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:23.112115    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:26.076965 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:26.076890    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:28.356285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.356253    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"]
Sep 11 21:20:28.356836 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.356506    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" podUID="35f2fbef-7efc-464a-8a06-292102a67aa7" containerName="maas-api" containerID="cri-o://59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73" gracePeriod=30
Sep 11 21:20:28.395794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.395754    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:28.421553 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.421522    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"]
Sep 11 21:20:28.421782 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.421756    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q" podUID="19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" containerName="payload-processing" containerID="cri-o://47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c" gracePeriod=30
Sep 11 21:20:28.497201 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.497167    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:28.535261 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.535230    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"]
Sep 11 21:20:28.535564 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.535532    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" podUID="a5c16cd9-7992-4534-aaa3-485e86dc286f" containerName="maas-api" containerID="cri-o://2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e" gracePeriod=30
Sep 11 21:20:28.596958 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.596922    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:28.752962 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.752938    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:20:28.757361 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.757313    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:28.762071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.762051    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:20:28.780234 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.780217    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:20:28.800502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.800474    2585 generic.go:356] "Generic (PLEG): container finished" podID="19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" containerID="47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c" exitCode=0
Sep 11 21:20:28.800610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.800506    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"
Sep 11 21:20:28.800610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.800503    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q" event={"ID":"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e","Type":"ContainerDied","Data":"47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c"}
Sep 11 21:20:28.800750 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.800635    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q" event={"ID":"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e","Type":"ContainerDied","Data":"6efcf1b7fc163937cf20e6d5f1628cde7f6d3684a59c23a7e6bfaf0f253e281a"}
Sep 11 21:20:28.800750 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.800688    2585 scope.go:117] "RemoveContainer" containerID="47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c"
Sep 11 21:20:28.802205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.802180    2585 generic.go:356] "Generic (PLEG): container finished" podID="35f2fbef-7efc-464a-8a06-292102a67aa7" containerID="59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73" exitCode=0
Sep 11 21:20:28.802322 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.802232    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"
Sep 11 21:20:28.802322 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.802291    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" event={"ID":"35f2fbef-7efc-464a-8a06-292102a67aa7","Type":"ContainerDied","Data":"59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73"}
Sep 11 21:20:28.802438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.802336    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx" event={"ID":"35f2fbef-7efc-464a-8a06-292102a67aa7","Type":"ContainerDied","Data":"28c0add9832ff3e694bdd1c245e906676bca4bdc9572e144b62c6aa6b8157cab"}
Sep 11 21:20:28.803983 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.803957    2585 generic.go:356] "Generic (PLEG): container finished" podID="a5c16cd9-7992-4534-aaa3-485e86dc286f" containerID="2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e" exitCode=0
Sep 11 21:20:28.804155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.804001    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"
Sep 11 21:20:28.804155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.804019    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" event={"ID":"a5c16cd9-7992-4534-aaa3-485e86dc286f","Type":"ContainerDied","Data":"2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e"}
Sep 11 21:20:28.804155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.804058    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx" event={"ID":"a5c16cd9-7992-4534-aaa3-485e86dc286f","Type":"ContainerDied","Data":"0170b44ca6975d7321e72a3cb3a1b74eecfea57ca96d2044209ebed285fbc448"}
Sep 11 21:20:28.814926 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.814905    2585 scope.go:117] "RemoveContainer" containerID="47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c"
Sep 11 21:20:28.815275 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:20:28.815254    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c\": container with ID starting with 47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c not found: ID does not exist" containerID="47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c"
Sep 11 21:20:28.815360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.815286    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c"} err="failed to get container status \"47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c\": rpc error: code = NotFound desc = could not find container \"47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c\": container with ID starting with 47546b3fd2d715d7339526523d9d0d1d42aa0fc9bca2995792084cd799e2113c not found: ID does not exist"
Sep 11 21:20:28.815360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.815305    2585 scope.go:117] "RemoveContainer" containerID="59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73"
Sep 11 21:20:28.825949 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.825923    2585 scope.go:117] "RemoveContainer" containerID="59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73"
Sep 11 21:20:28.826223 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:20:28.826203    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73\": container with ID starting with 59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73 not found: ID does not exist" containerID="59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73"
Sep 11 21:20:28.826305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.826233    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73"} err="failed to get container status \"59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73\": rpc error: code = NotFound desc = could not find container \"59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73\": container with ID starting with 59ae453700bea51056480072e517160456686fad7288158c5301a8349dd24b73 not found: ID does not exist"
Sep 11 21:20:28.826305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.826256    2585 scope.go:117] "RemoveContainer" containerID="2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e"
Sep 11 21:20:28.833455 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833437    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-metrics-certs\") pod \"a5c16cd9-7992-4534-aaa3-485e86dc286f\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") "
Sep 11 21:20:28.833558 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833481    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-plugins-config-volume\") pod \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") "
Sep 11 21:20:28.833558 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833520    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c16cd9-7992-4534-aaa3-485e86dc286f-openshift-service-ca\") pod \"a5c16cd9-7992-4534-aaa3-485e86dc286f\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") "
Sep 11 21:20:28.833704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833634    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-metrics-certs\") pod \"35f2fbef-7efc-464a-8a06-292102a67aa7\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") "
Sep 11 21:20:28.833704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833687    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbqtk\" (UniqueName: \"kubernetes.io/projected/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-kube-api-access-lbqtk\") pod \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\" (UID: \"19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e\") "
Sep 11 21:20:28.833825 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833721    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9sl8\" (UniqueName: \"kubernetes.io/projected/35f2fbef-7efc-464a-8a06-292102a67aa7-kube-api-access-j9sl8\") pod \"35f2fbef-7efc-464a-8a06-292102a67aa7\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") "
Sep 11 21:20:28.833825 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833753    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-979mf\" (UniqueName: \"kubernetes.io/projected/a5c16cd9-7992-4534-aaa3-485e86dc286f-kube-api-access-979mf\") pod \"a5c16cd9-7992-4534-aaa3-485e86dc286f\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") "
Sep 11 21:20:28.833825 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833816    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls\") pod \"35f2fbef-7efc-464a-8a06-292102a67aa7\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") "
Sep 11 21:20:28.833984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833878    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35f2fbef-7efc-464a-8a06-292102a67aa7-openshift-service-ca\") pod \"35f2fbef-7efc-464a-8a06-292102a67aa7\" (UID: \"35f2fbef-7efc-464a-8a06-292102a67aa7\") "
Sep 11 21:20:28.833984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833886    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5c16cd9-7992-4534-aaa3-485e86dc286f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5c16cd9-7992-4534-aaa3-485e86dc286f" (UID: "a5c16cd9-7992-4534-aaa3-485e86dc286f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:28.833984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.833911    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" (UID: "19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:28.834535 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.834504    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35f2fbef-7efc-464a-8a06-292102a67aa7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "35f2fbef-7efc-464a-8a06-292102a67aa7" (UID: "35f2fbef-7efc-464a-8a06-292102a67aa7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:20:28.834626 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.834562    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls\") pod \"a5c16cd9-7992-4534-aaa3-485e86dc286f\" (UID: \"a5c16cd9-7992-4534-aaa3-485e86dc286f\") "
Sep 11 21:20:28.834984 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.834959    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-plugins-config-volume\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.835077 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.834988    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5c16cd9-7992-4534-aaa3-485e86dc286f-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.835077 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.835002    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/35f2fbef-7efc-464a-8a06-292102a67aa7-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.835401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.835373    2585 scope.go:117] "RemoveContainer" containerID="2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e"
Sep 11 21:20:28.835786 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:20:28.835730    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e\": container with ID starting with 2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e not found: ID does not exist" containerID="2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e"
Sep 11 21:20:28.835786 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.835769    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e"} err="failed to get container status \"2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e\": rpc error: code = NotFound desc = could not find container \"2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e\": container with ID starting with 2e49f3b7c6cd3475533cd4dfafc57597fe283aab43cdb8fdc4a46fe8f62b910e not found: ID does not exist"
Sep 11 21:20:28.836111 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.836086    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5c16cd9-7992-4534-aaa3-485e86dc286f" (UID: "a5c16cd9-7992-4534-aaa3-485e86dc286f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:28.836567 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.836532    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5c16cd9-7992-4534-aaa3-485e86dc286f-kube-api-access-979mf" (OuterVolumeSpecName: "kube-api-access-979mf") pod "a5c16cd9-7992-4534-aaa3-485e86dc286f" (UID: "a5c16cd9-7992-4534-aaa3-485e86dc286f"). InnerVolumeSpecName "kube-api-access-979mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:28.836567 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.836552    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "35f2fbef-7efc-464a-8a06-292102a67aa7" (UID: "35f2fbef-7efc-464a-8a06-292102a67aa7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:28.836798 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.836555    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-kube-api-access-lbqtk" (OuterVolumeSpecName: "kube-api-access-lbqtk") pod "19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" (UID: "19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e"). InnerVolumeSpecName "kube-api-access-lbqtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:28.837525 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.837497    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35f2fbef-7efc-464a-8a06-292102a67aa7-kube-api-access-j9sl8" (OuterVolumeSpecName: "kube-api-access-j9sl8") pod "35f2fbef-7efc-464a-8a06-292102a67aa7" (UID: "35f2fbef-7efc-464a-8a06-292102a67aa7"). InnerVolumeSpecName "kube-api-access-j9sl8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:20:28.837597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.837584    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "35f2fbef-7efc-464a-8a06-292102a67aa7" (UID: "35f2fbef-7efc-464a-8a06-292102a67aa7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:28.837715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.837692    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5c16cd9-7992-4534-aaa3-485e86dc286f" (UID: "a5c16cd9-7992-4534-aaa3-485e86dc286f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:20:28.936392 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936312    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.936392 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936353    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.936392 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936367    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5c16cd9-7992-4534-aaa3-485e86dc286f-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.936392 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936379    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/35f2fbef-7efc-464a-8a06-292102a67aa7-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.936628 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936393    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbqtk\" (UniqueName: \"kubernetes.io/projected/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e-kube-api-access-lbqtk\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.936628 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936408    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9sl8\" (UniqueName: \"kubernetes.io/projected/35f2fbef-7efc-464a-8a06-292102a67aa7-kube-api-access-j9sl8\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.936628 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.936421    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-979mf\" (UniqueName: \"kubernetes.io/projected/a5c16cd9-7992-4534-aaa3-485e86dc286f-kube-api-access-979mf\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:20:28.988258 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:28.988217    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.085067 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.085030    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.125942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.125915    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"]
Sep 11 21:20:29.132399 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.132376    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-962a7d-5667fd497c-xg52q"]
Sep 11 21:20:29.144898 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.144871    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"]
Sep 11 21:20:29.148741 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.148719    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-ea5e33-6fb8d57688-8vdkx"]
Sep 11 21:20:29.152878 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.152852    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.161238 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.161215    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"]
Sep 11 21:20:29.164975 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.164951    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-962a7d-77f8c75869-gjtdx"]
Sep 11 21:20:29.268118 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.268035    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.505537 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.505503    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:29.886771 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.886735    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" path="/var/lib/kubelet/pods/19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e/volumes"
Sep 11 21:20:29.887181 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.887165    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35f2fbef-7efc-464a-8a06-292102a67aa7" path="/var/lib/kubelet/pods/35f2fbef-7efc-464a-8a06-292102a67aa7/volumes"
Sep 11 21:20:29.887525 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.887511    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5c16cd9-7992-4534-aaa3-485e86dc286f" path="/var/lib/kubelet/pods/a5c16cd9-7992-4534-aaa3-485e86dc286f/volumes"
Sep 11 21:20:29.985116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:29.985088    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:30.889217 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:30.889172    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:30.990370 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:30.990335    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:31.697389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:31.697354    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:31.919395 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:31.919364    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:20:31.920162 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:31.920142    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:20:31.925022 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:31.925001    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:20:31.925751 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:31.925726    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:20:34.911616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:34.911579    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:35.012012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:35.011972    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:35.179609 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:35.179506    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:35.576413 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:35.576376    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:35.676555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:35.676519    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:35.824388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:35.824355    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:36.852726 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:36.852686    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:36.953595 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:36.953555    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:37.053849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:37.053821    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:47.543232 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:47.543175    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:49.223310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:49.223277    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:52.696964 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:52.696922    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:52.754775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:52.754737    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:53.034204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:53.034159    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:53.347336 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:53.347254    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:53.721557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:53.721478    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:54.025830 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:54.025748    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:54.193308 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:54.193266    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:54.410569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:54.410538    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:54.519091 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:54.519057    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:54.594133 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:54.594091    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:54.666098 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:54.666033    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:55.344464 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:55.344431    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:55.445260 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:55.445226    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:55.542083 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:55.542050    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:56.169467 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:56.169425    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:56.877967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:56.877935    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:57.041350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:57.041314    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:57.138675 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:57.138566    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:57.237786 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:57.237753    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:58.006361 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.006317    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:58.668922 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.668890    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"]
Sep 11 21:20:58.669583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669559    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec0d4ee7-77ec-4ea7-b097-e510a831fed1" containerName="maas-api"
Sep 11 21:20:58.669583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669582    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec0d4ee7-77ec-4ea7-b097-e510a831fed1" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669595    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35f2fbef-7efc-464a-8a06-292102a67aa7" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669601    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="35f2fbef-7efc-464a-8a06-292102a67aa7" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669608    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e1119bf-7021-4bca-ad7e-d31413f9c709" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669613    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e1119bf-7021-4bca-ad7e-d31413f9c709" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669622    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" containerName="payload-processing"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669627    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" containerName="payload-processing"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669653    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5c16cd9-7992-4534-aaa3-485e86dc286f" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669659    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5c16cd9-7992-4534-aaa3-485e86dc286f" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669737    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5c16cd9-7992-4534-aaa3-485e86dc286f" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669744    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e1119bf-7021-4bca-ad7e-d31413f9c709" containerName="maas-api"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669750    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="19ad6f6c-4692-415f-a20c-e3d0f2bf2a7e" containerName="payload-processing"
Sep 11 21:20:58.669753 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669758    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec0d4ee7-77ec-4ea7-b097-e510a831fed1" containerName="maas-api"
Sep 11 21:20:58.670117 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.669766    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="35f2fbef-7efc-464a-8a06-292102a67aa7" containerName="maas-api"
Sep 11 21:20:58.672809 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.672793    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.675438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.675416    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-7ae28e-serving-cert\""
Sep 11 21:20:58.684274 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.684248    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"]
Sep 11 21:20:58.703711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.703685    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgjbr\" (UniqueName: \"kubernetes.io/projected/6d6a73f0-26e8-4a57-a614-a15a6b493684-kube-api-access-jgjbr\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.703822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.703723    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-maas-api-tls\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.703822 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.703745    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a73f0-26e8-4a57-a614-a15a6b493684-openshift-service-ca\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.703940 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.703851    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-metrics-certs\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.708049 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.708021    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:58.772360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.772340    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:58.804901 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.804883    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-metrics-certs\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.804998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.804942    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgjbr\" (UniqueName: \"kubernetes.io/projected/6d6a73f0-26e8-4a57-a614-a15a6b493684-kube-api-access-jgjbr\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.804998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.804964    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-maas-api-tls\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.804998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.804982    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a73f0-26e8-4a57-a614-a15a6b493684-openshift-service-ca\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.805610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.805587    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a73f0-26e8-4a57-a614-a15a6b493684-openshift-service-ca\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.807432 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.807412    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-metrics-certs\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.807540 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.807525    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-maas-api-tls\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.814605 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.814583    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgjbr\" (UniqueName: \"kubernetes.io/projected/6d6a73f0-26e8-4a57-a614-a15a6b493684-kube-api-access-jgjbr\") pod \"maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:58.870613 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.870584    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:58.986519 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:58.986450    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:59.260107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:59.260073    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"]
Sep 11 21:20:59.261225 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:20:59.261202    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6a73f0_26e8_4a57_a614_a15a6b493684.slice/crio-2ed6442a2bf519d8b12d53029c2cdcc47d3273d899e1cae6ab7f962e435214ac WatchSource:0}: Error finding container 2ed6442a2bf519d8b12d53029c2cdcc47d3273d899e1cae6ab7f962e435214ac: Status 404 returned error can't find the container with id 2ed6442a2bf519d8b12d53029c2cdcc47d3273d899e1cae6ab7f962e435214ac
Sep 11 21:20:59.314217 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:59.314180    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:59.382270 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:59.382246    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:20:59.994716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:59.994569    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4" event={"ID":"6d6a73f0-26e8-4a57-a614-a15a6b493684","Type":"ContainerStarted","Data":"e62f52cf2ac77c95a44d6265d59946a1b6ad3a238af720b999c922ddf9c12874"}
Sep 11 21:20:59.994716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:59.994679    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:20:59.994716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:20:59.994709    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4" event={"ID":"6d6a73f0-26e8-4a57-a614-a15a6b493684","Type":"ContainerStarted","Data":"2ed6442a2bf519d8b12d53029c2cdcc47d3273d899e1cae6ab7f962e435214ac"}
Sep 11 21:21:00.014756 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:00.014704    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4" podStartSLOduration=1.680736579 podStartE2EDuration="2.014686615s" totalImagesPullingTime="333.950036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:00.013211206 +0000 UTC m=+928.604724530" watchObservedRunningTime="2026-09-11 21:21:00.014686615 +0000 UTC m=+928.606199938"
Sep 11 21:21:00.087132 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:00.087092    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:00.735733 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:00.735700    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:00.961066 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:00.961034    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:01.514258 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:01.514223    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:02.945475 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:02.945434    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:03.017165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:03.017130    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:03.594609 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:03.594558    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:06.005167 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:06.005136    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:21:09.826962 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:09.826911    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:09.893169 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:09.893131    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:10.057833 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:10.057805    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:10.369139 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:10.369057    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:10.560073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:10.560038    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:16.105065 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:16.105031    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:16.712367 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:16.712329    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:16.812208 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:16.812168    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:17.084823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:17.084782    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:18.010600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:18.010565    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:18.892210 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:18.892175    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:19.762101 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.762064    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"]
Sep 11 21:21:19.770958 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.770928    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.773532 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.773504    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"]
Sep 11 21:21:19.773966 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.773943    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e85410da-serving-cert\""
Sep 11 21:21:19.798296 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.798244    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:19.886411 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.886373    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-maas-api-tls\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.886627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.886430    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2t6\" (UniqueName: \"kubernetes.io/projected/2a753634-b40d-4a9e-8e0d-cc43419bc03a-kube-api-access-gw2t6\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.886627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.886537    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-metrics-certs\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.886627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.886581    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a753634-b40d-4a9e-8e0d-cc43419bc03a-openshift-service-ca\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.899357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.899326    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:19.987837 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.987805    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-metrics-certs\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.988035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.987849    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a753634-b40d-4a9e-8e0d-cc43419bc03a-openshift-service-ca\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.988035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.987889    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-maas-api-tls\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.988035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.987910    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2t6\" (UniqueName: \"kubernetes.io/projected/2a753634-b40d-4a9e-8e0d-cc43419bc03a-kube-api-access-gw2t6\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.988598 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.988574    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a753634-b40d-4a9e-8e0d-cc43419bc03a-openshift-service-ca\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.990315 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.990291    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-maas-api-tls\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.990440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.990418    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-metrics-certs\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:19.995404 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:19.995383    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2t6\" (UniqueName: \"kubernetes.io/projected/2a753634-b40d-4a9e-8e0d-cc43419bc03a-kube-api-access-gw2t6\") pod \"maas-api-e2e-mt-e85410da-59d87b69c-kskwj\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:20.085438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:20.085405    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:20.307121 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:20.307089    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:20.360839 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:20.360807    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"]
Sep 11 21:21:20.362792 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:21:20.362761    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a753634_b40d_4a9e_8e0d_cc43419bc03a.slice/crio-ab6b1325fc8735424e1f6e7cb048affc8b45f25027057146d472c884ae0b2488 WatchSource:0}: Error finding container ab6b1325fc8735424e1f6e7cb048affc8b45f25027057146d472c884ae0b2488: Status 404 returned error can't find the container with id ab6b1325fc8735424e1f6e7cb048affc8b45f25027057146d472c884ae0b2488
Sep 11 21:21:20.408348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:20.408311    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:20.704823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:20.704732    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:21.118987 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:21.118953    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj" event={"ID":"2a753634-b40d-4a9e-8e0d-cc43419bc03a","Type":"ContainerStarted","Data":"8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372"}
Sep 11 21:21:21.119383 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:21.119010    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj" event={"ID":"2a753634-b40d-4a9e-8e0d-cc43419bc03a","Type":"ContainerStarted","Data":"ab6b1325fc8735424e1f6e7cb048affc8b45f25027057146d472c884ae0b2488"}
Sep 11 21:21:21.119383 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:21.119041    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:21.141119 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:21.141074    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj" podStartSLOduration=1.7516766000000001 podStartE2EDuration="2.141060038s" totalImagesPullingTime="389.383438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:21:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:21:21.137538224 +0000 UTC m=+949.729051547" watchObservedRunningTime="2026-09-11 21:21:21.141060038 +0000 UTC m=+949.732573360"
Sep 11 21:21:21.599495 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:21.599464    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:21.716544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:21.716511    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:22.281259 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:22.281218    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:23.111765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:23.111728    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:23.819736 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:23.819700    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:27.131031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:27.131000    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:21:27.216050 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:27.216013    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:34.453741 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:34.453691    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:34.556609 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:34.556570    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:34.716348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:34.716263    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:34.819807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:34.819766    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:41.629921 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:41.629883    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:41.899939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:41.899852    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:42.145097 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:42.145055    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:42.305308 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:42.305271    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:42.404929 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:42.404886    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:42.737760 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:42.737629    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:42.974399 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:42.974365    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:43.760031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:43.759986    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:44.564375 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:44.564335    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:45.269096 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:45.269053    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:48.599570 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:48.599531    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:48.695920 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:48.695882    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:49.921845 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:49.921797    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:50.657135 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:50.657088    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:51.384608 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:51.384568    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:52.121534 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:52.121499    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:52.814380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:52.814344    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:58.087462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:58.087371    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:58.460422 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:58.460320    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:59.288604 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:59.288566    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:59.871434 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:59.871390    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:21:59.973043 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:21:59.972999    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:00.073663 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.073599    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:00.566425 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.566389    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"]
Sep 11 21:22:00.566939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.566654    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj" podUID="2a753634-b40d-4a9e-8e0d-cc43419bc03a" containerName="maas-api" containerID="cri-o://8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372" gracePeriod=30
Sep 11 21:22:00.603123 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.603087    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:00.701034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.700998    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:00.801417 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.801383    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:00.825659 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.825591    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:22:00.881140 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.881107    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw2t6\" (UniqueName: \"kubernetes.io/projected/2a753634-b40d-4a9e-8e0d-cc43419bc03a-kube-api-access-gw2t6\") pod \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") "
Sep 11 21:22:00.881316 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.881177    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-metrics-certs\") pod \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") "
Sep 11 21:22:00.881316 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.881205    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-maas-api-tls\") pod \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") "
Sep 11 21:22:00.881316 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.881265    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a753634-b40d-4a9e-8e0d-cc43419bc03a-openshift-service-ca\") pod \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\" (UID: \"2a753634-b40d-4a9e-8e0d-cc43419bc03a\") "
Sep 11 21:22:00.881754 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.881724    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a753634-b40d-4a9e-8e0d-cc43419bc03a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2a753634-b40d-4a9e-8e0d-cc43419bc03a" (UID: "2a753634-b40d-4a9e-8e0d-cc43419bc03a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:00.883267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.883237    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2a753634-b40d-4a9e-8e0d-cc43419bc03a" (UID: "2a753634-b40d-4a9e-8e0d-cc43419bc03a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:22:00.883359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.883267    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2a753634-b40d-4a9e-8e0d-cc43419bc03a" (UID: "2a753634-b40d-4a9e-8e0d-cc43419bc03a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:22:00.883359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.883281    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a753634-b40d-4a9e-8e0d-cc43419bc03a-kube-api-access-gw2t6" (OuterVolumeSpecName: "kube-api-access-gw2t6") pod "2a753634-b40d-4a9e-8e0d-cc43419bc03a" (UID: "2a753634-b40d-4a9e-8e0d-cc43419bc03a"). InnerVolumeSpecName "kube-api-access-gw2t6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:00.901227 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.901193    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:00.982350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.982320    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2a753634-b40d-4a9e-8e0d-cc43419bc03a-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:00.982350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.982347    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw2t6\" (UniqueName: \"kubernetes.io/projected/2a753634-b40d-4a9e-8e0d-cc43419bc03a-kube-api-access-gw2t6\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:00.982350 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.982358    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:00.982583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.982366    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2a753634-b40d-4a9e-8e0d-cc43419bc03a-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:00.989221 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:00.989182    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:01.190939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.190859    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:01.354339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.354300    2585 generic.go:356] "Generic (PLEG): container finished" podID="2a753634-b40d-4a9e-8e0d-cc43419bc03a" containerID="8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372" exitCode=0
Sep 11 21:22:01.354508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.354352    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"
Sep 11 21:22:01.354508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.354382    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj" event={"ID":"2a753634-b40d-4a9e-8e0d-cc43419bc03a","Type":"ContainerDied","Data":"8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372"}
Sep 11 21:22:01.354508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.354441    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj" event={"ID":"2a753634-b40d-4a9e-8e0d-cc43419bc03a","Type":"ContainerDied","Data":"ab6b1325fc8735424e1f6e7cb048affc8b45f25027057146d472c884ae0b2488"}
Sep 11 21:22:01.354508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.354466    2585 scope.go:117] "RemoveContainer" containerID="8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372"
Sep 11 21:22:01.365136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.365118    2585 scope.go:117] "RemoveContainer" containerID="8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372"
Sep 11 21:22:01.365413 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:22:01.365393    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372\": container with ID starting with 8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372 not found: ID does not exist" containerID="8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372"
Sep 11 21:22:01.365479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.365421    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372"} err="failed to get container status \"8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372\": rpc error: code = NotFound desc = could not find container \"8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372\": container with ID starting with 8c4b7294e72138d2442dad68de9aadfc3ea8120ef4635f61c131d1f0bb8b3372 not found: ID does not exist"
Sep 11 21:22:01.391975 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.391949    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"]
Sep 11 21:22:01.395949 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.395923    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e85410da-59d87b69c-kskwj"]
Sep 11 21:22:01.875992 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.875958    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:01.892371 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:01.892331    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a753634-b40d-4a9e-8e0d-cc43419bc03a" path="/var/lib/kubelet/pods/2a753634-b40d-4a9e-8e0d-cc43419bc03a/volumes"
Sep 11 21:22:02.686587 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:02.686545    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:03.405570 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:03.405533    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:04.105688 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:04.105633    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:07.040161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:07.040127    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:07.107951 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:07.107922    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:07.299790 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:07.299693    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:07.648100 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:07.648016    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:07.748765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:07.748729    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:07.847622 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:07.847583    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:08.480621 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:08.480574    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.173067 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.173032    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"]
Sep 11 21:22:09.173319 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.173281    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4" podUID="6d6a73f0-26e8-4a57-a614-a15a6b493684" containerName="maas-api" containerID="cri-o://e62f52cf2ac77c95a44d6265d59946a1b6ad3a238af720b999c922ddf9c12874" gracePeriod=30
Sep 11 21:22:09.207698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.207667    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.286615 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.286585    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.386844 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.386814    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.411935 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.411434    2585 generic.go:356] "Generic (PLEG): container finished" podID="6d6a73f0-26e8-4a57-a614-a15a6b493684" containerID="e62f52cf2ac77c95a44d6265d59946a1b6ad3a238af720b999c922ddf9c12874" exitCode=0
Sep 11 21:22:09.411935 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.411565    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4" event={"ID":"6d6a73f0-26e8-4a57-a614-a15a6b493684","Type":"ContainerDied","Data":"e62f52cf2ac77c95a44d6265d59946a1b6ad3a238af720b999c922ddf9c12874"}
Sep 11 21:22:09.411935 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.411615    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4" event={"ID":"6d6a73f0-26e8-4a57-a614-a15a6b493684","Type":"ContainerDied","Data":"2ed6442a2bf519d8b12d53029c2cdcc47d3273d899e1cae6ab7f962e435214ac"}
Sep 11 21:22:09.411935 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.411656    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ed6442a2bf519d8b12d53029c2cdcc47d3273d899e1cae6ab7f962e435214ac"
Sep 11 21:22:09.428995 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.428912    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:22:09.549454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.549419    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.563903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.563875    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-maas-api-tls\") pod \"6d6a73f0-26e8-4a57-a614-a15a6b493684\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") "
Sep 11 21:22:09.564055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.563915    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-metrics-certs\") pod \"6d6a73f0-26e8-4a57-a614-a15a6b493684\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") "
Sep 11 21:22:09.564055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.563951    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a73f0-26e8-4a57-a614-a15a6b493684-openshift-service-ca\") pod \"6d6a73f0-26e8-4a57-a614-a15a6b493684\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") "
Sep 11 21:22:09.564055 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.564007    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jgjbr\" (UniqueName: \"kubernetes.io/projected/6d6a73f0-26e8-4a57-a614-a15a6b493684-kube-api-access-jgjbr\") pod \"6d6a73f0-26e8-4a57-a614-a15a6b493684\" (UID: \"6d6a73f0-26e8-4a57-a614-a15a6b493684\") "
Sep 11 21:22:09.564369 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.564337    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d6a73f0-26e8-4a57-a614-a15a6b493684-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6d6a73f0-26e8-4a57-a614-a15a6b493684" (UID: "6d6a73f0-26e8-4a57-a614-a15a6b493684"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:22:09.566080 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.566050    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6d6a73f0-26e8-4a57-a614-a15a6b493684" (UID: "6d6a73f0-26e8-4a57-a614-a15a6b493684"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:22:09.566213 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.566138    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6d6a73f0-26e8-4a57-a614-a15a6b493684" (UID: "6d6a73f0-26e8-4a57-a614-a15a6b493684"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:22:09.566213 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.566131    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6a73f0-26e8-4a57-a614-a15a6b493684-kube-api-access-jgjbr" (OuterVolumeSpecName: "kube-api-access-jgjbr") pod "6d6a73f0-26e8-4a57-a614-a15a6b493684" (UID: "6d6a73f0-26e8-4a57-a614-a15a6b493684"). InnerVolumeSpecName "kube-api-access-jgjbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:22:09.632479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.632448    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.665122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.665096    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.665122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.665120    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6d6a73f0-26e8-4a57-a614-a15a6b493684-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.665122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.665129    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6d6a73f0-26e8-4a57-a614-a15a6b493684-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.665343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.665138    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jgjbr\" (UniqueName: \"kubernetes.io/projected/6d6a73f0-26e8-4a57-a614-a15a6b493684-kube-api-access-jgjbr\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:22:09.872470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.872432    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:09.973468 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:09.973427    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:10.417302 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:10.417267    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"
Sep 11 21:22:10.434311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:10.434279    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"]
Sep 11 21:22:10.438166 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:10.438139    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7ae28e-7c9fb8c65d-dcfr4"]
Sep 11 21:22:10.679177 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:10.679087    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:11.396179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:11.396145    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:11.887218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:11.887182    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6a73f0-26e8-4a57-a614-a15a6b493684" path="/var/lib/kubelet/pods/6d6a73f0-26e8-4a57-a614-a15a6b493684/volumes"
Sep 11 21:22:13.917019 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:13.916987    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:14.018671 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:14.018622    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:14.117700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:14.117661    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:14.248941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:14.248850    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:15.779705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:15.779669    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:15.853347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:15.853318    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:16.049107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:16.049066    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:16.480166 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:16.480072    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:16.805587 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:16.805550    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:17.022197 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:17.022149    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:18.162061 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:18.162023    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:18.251352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:18.251315    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:18.360320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:18.360285    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:18.988678 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:18.988622    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:20.386530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:20.386494    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:20.484518 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:20.484477    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:21.262120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:21.262079    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:21.606201 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:21.606129    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:21.699415 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:21.699378    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:24.547687 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:24.547625    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:24.776707 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:24.776672    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:24.869823 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:24.869734    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:25.399914 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:25.399880    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:26.208867 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.208833    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"]
Sep 11 21:22:26.209420 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.209399    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a753634-b40d-4a9e-8e0d-cc43419bc03a" containerName="maas-api"
Sep 11 21:22:26.209507 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.209423    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a753634-b40d-4a9e-8e0d-cc43419bc03a" containerName="maas-api"
Sep 11 21:22:26.209507 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.209462    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6a73f0-26e8-4a57-a614-a15a6b493684" containerName="maas-api"
Sep 11 21:22:26.209507 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.209472    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6a73f0-26e8-4a57-a614-a15a6b493684" containerName="maas-api"
Sep 11 21:22:26.209676 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.209570    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6a73f0-26e8-4a57-a614-a15a6b493684" containerName="maas-api"
Sep 11 21:22:26.209676 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.209589    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a753634-b40d-4a9e-8e0d-cc43419bc03a" containerName="maas-api"
Sep 11 21:22:26.214031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.214008    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.216251 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.216224    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-1117b2-serving-cert\""
Sep 11 21:22:26.224274 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.224247    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"]
Sep 11 21:22:26.270046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.270019    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:26.316618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.316575    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.316618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.316614    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgfxc\" (UniqueName: \"kubernetes.io/projected/8ce5100e-e484-400f-b6d6-80e809eb373e-kube-api-access-hgfxc\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.316874 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.316667    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.316874 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.316727    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce5100e-e484-400f-b6d6-80e809eb373e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.371196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.371159    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:26.417856 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.417826    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.418002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.417865    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgfxc\" (UniqueName: \"kubernetes.io/projected/8ce5100e-e484-400f-b6d6-80e809eb373e-kube-api-access-hgfxc\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.418002 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.417899    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.418002 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:22:26.417981    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-serving-cert: secret "maas-api-e2e-shared-a-w2-1117b2-serving-cert" not found
Sep 11 21:22:26.418167 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:22:26.418050    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls podName:8ce5100e-e484-400f-b6d6-80e809eb373e nodeName:}" failed. No retries permitted until 2026-09-11 21:22:26.918028893 +0000 UTC m=+1015.509542195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls") pod "maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" (UID: "8ce5100e-e484-400f-b6d6-80e809eb373e") : secret "maas-api-e2e-shared-a-w2-1117b2-serving-cert" not found
Sep 11 21:22:26.418167 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.418071    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce5100e-e484-400f-b6d6-80e809eb373e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.418728 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.418710    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce5100e-e484-400f-b6d6-80e809eb373e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.420285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.420255    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.428307 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.428286    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgfxc\" (UniqueName: \"kubernetes.io/projected/8ce5100e-e484-400f-b6d6-80e809eb373e-kube-api-access-hgfxc\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.765314 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.765281    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:26.871925 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.871890    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:26.923444 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.923412    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.925932 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.925906    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:26.941603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:26.941580    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:27.126539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:27.126500    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:27.402944 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:27.402914    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"]
Sep 11 21:22:27.404029 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:22:27.404004    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce5100e_e484_400f_b6d6_80e809eb373e.slice/crio-9cb8b44c060e95473399ee564aed780f12f0cfda663e6c2cf86609888e1fd7ff WatchSource:0}: Error finding container 9cb8b44c060e95473399ee564aed780f12f0cfda663e6c2cf86609888e1fd7ff: Status 404 returned error can't find the container with id 9cb8b44c060e95473399ee564aed780f12f0cfda663e6c2cf86609888e1fd7ff
Sep 11 21:22:27.405448 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:27.405434    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:22:27.525044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:27.525014    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" event={"ID":"8ce5100e-e484-400f-b6d6-80e809eb373e","Type":"ContainerStarted","Data":"9cb8b44c060e95473399ee564aed780f12f0cfda663e6c2cf86609888e1fd7ff"}
Sep 11 21:22:28.532557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:28.532521    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" event={"ID":"8ce5100e-e484-400f-b6d6-80e809eb373e","Type":"ContainerStarted","Data":"6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e"}
Sep 11 21:22:28.532970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:28.532626    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:28.552521 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:28.552473    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" podStartSLOduration=2.149113449 podStartE2EDuration="2.552457713s" totalImagesPullingTime="403.344264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:28.55220322 +0000 UTC m=+1017.143716543" watchObservedRunningTime="2026-09-11 21:22:28.552457713 +0000 UTC m=+1017.143971037"
Sep 11 21:22:34.544109 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:34.544077    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:22:37.361457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:37.361423    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:41.927221 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:41.927185    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:47.185487 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:47.185453    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:48.653890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:48.653847    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:49.611419 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:49.611374    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:49.741678 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:49.741623    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:50.077303 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:50.077252    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:50.385237 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:50.385141    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:50.485037 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:50.485005    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:50.591107 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:50.591069    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:51.308768 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:51.308731    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:52.125831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:52.125787    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:52.371304 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:52.371272    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.100510 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:53.100466    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.218198 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:53.218152    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.291977 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:53.291945    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.467879 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:53.467800    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.566597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:53.566558    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:53.667299 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:53.667266    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:54.305161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:54.305127    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:54.524574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:54.524540    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:55.501327 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:55.501289    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:56.174377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.174341    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"]
Sep 11 21:22:56.178245 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.178225    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.180883 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.180860    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-55fb09-serving-cert\""
Sep 11 21:22:56.194065 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.193991    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"]
Sep 11 21:22:56.215831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.215808    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:56.281930 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.281910    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.282040 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.281951    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ftbr\" (UniqueName: \"kubernetes.io/projected/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-kube-api-access-6ftbr\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.282040 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.281974    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.282139 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.282115    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.316610 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.316579    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:56.382811 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.382776    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.382951 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.382845    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ftbr\" (UniqueName: \"kubernetes.io/projected/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-kube-api-access-6ftbr\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.382951 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.382883    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.383076 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.383006    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.383566 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.383538    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.385447 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.385419    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.385530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.385419    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.391088 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.391066    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ftbr\" (UniqueName: \"kubernetes.io/projected/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-kube-api-access-6ftbr\") pod \"maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.416912 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.416874    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:56.489029 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.488970    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:56.765872 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.765842    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"]
Sep 11 21:22:56.767428 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:22:56.767397    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f4fb91b_35ed_4907_9c9f_b7c5c936434d.slice/crio-232f67d14e05f4a43987aca846d552e54bc8fa0edccd64729bd3b9af7d95c0ba WatchSource:0}: Error finding container 232f67d14e05f4a43987aca846d552e54bc8fa0edccd64729bd3b9af7d95c0ba: Status 404 returned error can't find the container with id 232f67d14e05f4a43987aca846d552e54bc8fa0edccd64729bd3b9af7d95c0ba
Sep 11 21:22:56.818463 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.818430    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:56.916687 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:56.916657    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:57.386092 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:57.386006    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:57.704910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:57.704823    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd" event={"ID":"4f4fb91b-35ed-4907-9c9f-b7c5c936434d","Type":"ContainerStarted","Data":"4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f"}
Sep 11 21:22:57.704910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:57.704872    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd" event={"ID":"4f4fb91b-35ed-4907-9c9f-b7c5c936434d","Type":"ContainerStarted","Data":"232f67d14e05f4a43987aca846d552e54bc8fa0edccd64729bd3b9af7d95c0ba"}
Sep 11 21:22:57.705122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:57.704965    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:22:57.726288 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:57.726240    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd" podStartSLOduration=1.363976209 podStartE2EDuration="1.726228039s" totalImagesPullingTime="362.25183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:22:57.72451981 +0000 UTC m=+1046.316033134" watchObservedRunningTime="2026-09-11 21:22:57.726228039 +0000 UTC m=+1046.317741362"
Sep 11 21:22:58.208442 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:58.208408    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:58.603329 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:58.603294    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:59.177606 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:59.177567    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:22:59.882001 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:22:59.881961    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:03.717847 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:03.717818    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:23:04.782352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:04.782316    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:05.519294 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.519260    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"]
Sep 11 21:23:05.519485 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.519466    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p" podUID="ebde6f00-be59-41c2-be83-ec68ddae72ba" containerName="maas-api" containerID="cri-o://2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf" gracePeriod=30
Sep 11 21:23:05.552805 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.552771    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:05.628126 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.628094    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:05.696954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.696920    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:05.760555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.760521    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:05.992189 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:05.992165    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:23:06.102616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.102527    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:06.177586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.177557    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-maas-api-tls\") pod \"ebde6f00-be59-41c2-be83-ec68ddae72ba\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") "
Sep 11 21:23:06.177765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.177594    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-metrics-certs\") pod \"ebde6f00-be59-41c2-be83-ec68ddae72ba\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") "
Sep 11 21:23:06.177765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.177705    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebde6f00-be59-41c2-be83-ec68ddae72ba-openshift-service-ca\") pod \"ebde6f00-be59-41c2-be83-ec68ddae72ba\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") "
Sep 11 21:23:06.177765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.177748    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7xb4\" (UniqueName: \"kubernetes.io/projected/ebde6f00-be59-41c2-be83-ec68ddae72ba-kube-api-access-t7xb4\") pod \"ebde6f00-be59-41c2-be83-ec68ddae72ba\" (UID: \"ebde6f00-be59-41c2-be83-ec68ddae72ba\") "
Sep 11 21:23:06.178109 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.178079    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebde6f00-be59-41c2-be83-ec68ddae72ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ebde6f00-be59-41c2-be83-ec68ddae72ba" (UID: "ebde6f00-be59-41c2-be83-ec68ddae72ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:06.179735 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.179710    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ebde6f00-be59-41c2-be83-ec68ddae72ba" (UID: "ebde6f00-be59-41c2-be83-ec68ddae72ba"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:23:06.179826 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.179762    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ebde6f00-be59-41c2-be83-ec68ddae72ba" (UID: "ebde6f00-be59-41c2-be83-ec68ddae72ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:23:06.179950 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.179929    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebde6f00-be59-41c2-be83-ec68ddae72ba-kube-api-access-t7xb4" (OuterVolumeSpecName: "kube-api-access-t7xb4") pod "ebde6f00-be59-41c2-be83-ec68ddae72ba" (UID: "ebde6f00-be59-41c2-be83-ec68ddae72ba"). InnerVolumeSpecName "kube-api-access-t7xb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:06.215426 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.215400    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:06.278758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.278730    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.278758 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.278754    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebde6f00-be59-41c2-be83-ec68ddae72ba-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.278910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.278763    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebde6f00-be59-41c2-be83-ec68ddae72ba-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.278910 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.278773    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7xb4\" (UniqueName: \"kubernetes.io/projected/ebde6f00-be59-41c2-be83-ec68ddae72ba-kube-api-access-t7xb4\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:06.759686 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.759631    2585 generic.go:356] "Generic (PLEG): container finished" podID="ebde6f00-be59-41c2-be83-ec68ddae72ba" containerID="2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf" exitCode=0
Sep 11 21:23:06.759882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.759681    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p" event={"ID":"ebde6f00-be59-41c2-be83-ec68ddae72ba","Type":"ContainerDied","Data":"2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf"}
Sep 11 21:23:06.759882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.759744    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p" event={"ID":"ebde6f00-be59-41c2-be83-ec68ddae72ba","Type":"ContainerDied","Data":"96f86b9b03aacce87bc2e43a112616758b4dcfc50d5f0058eae2b3ca85e5aa38"}
Sep 11 21:23:06.759882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.759774    2585 scope.go:117] "RemoveContainer" containerID="2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf"
Sep 11 21:23:06.759882 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.759694    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"
Sep 11 21:23:06.770472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.770459    2585 scope.go:117] "RemoveContainer" containerID="2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf"
Sep 11 21:23:06.770730 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:23:06.770710    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf\": container with ID starting with 2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf not found: ID does not exist" containerID="2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf"
Sep 11 21:23:06.770802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.770737    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf"} err="failed to get container status \"2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf\": rpc error: code = NotFound desc = could not find container \"2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf\": container with ID starting with 2c3ec77698b6875363533bcef7f75a21790ba9da4f7daaa5c6b11f8c015d4fbf not found: ID does not exist"
Sep 11 21:23:06.782670 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.782628    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"]
Sep 11 21:23:06.785080 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.785056    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-26462a-79fffcbd4-www4p"]
Sep 11 21:23:06.993202 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:06.993170    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:07.696541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:07.696512    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:07.798001 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:07.797966    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:07.887115 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:07.887083    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebde6f00-be59-41c2-be83-ec68ddae72ba" path="/var/lib/kubelet/pods/ebde6f00-be59-41c2-be83-ec68ddae72ba/volumes"
Sep 11 21:23:08.431893 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:08.431857    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:09.214956 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:09.214912    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:09.931803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:09.931773    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:11.909549 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:11.909518    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:12.016172 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:12.016136    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:12.170256 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:12.170173    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:13.445364 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:13.445326    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:14.564657 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:14.564593    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:15.292814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:15.292774    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:16.095179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:16.095145    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:16.740879 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:16.740841    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:17.064524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:17.064468    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:17.227136 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:17.227097    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:17.353382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:17.353295    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:17.848552 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:17.848516    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:19.557449 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:19.557411    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:20.231788 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:20.231741    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:20.327439 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:20.327380    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:20.691508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:20.691470    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:21.555380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:21.555338    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:22.260282 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:22.260251    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:23.063769 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.063736    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"]
Sep 11 21:23:23.064174 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.064159    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebde6f00-be59-41c2-be83-ec68ddae72ba" containerName="maas-api"
Sep 11 21:23:23.064252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.064175    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebde6f00-be59-41c2-be83-ec68ddae72ba" containerName="maas-api"
Sep 11 21:23:23.064252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.064243    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebde6f00-be59-41c2-be83-ec68ddae72ba" containerName="maas-api"
Sep 11 21:23:23.068777 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.068752    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.071031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.071008    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-908a1435-serving-cert\""
Sep 11 21:23:23.079574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.079552    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"]
Sep 11 21:23:23.102282 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.102255    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:23.115215 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.115191    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.115334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.115234    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qw2q\" (UniqueName: \"kubernetes.io/projected/96b2ee0b-e508-4a91-9abb-543d0904fe6a-kube-api-access-5qw2q\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.115334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.115256    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-metrics-certs\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.115415 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.115353    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2ee0b-e508-4a91-9abb-543d0904fe6a-openshift-service-ca\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.166466 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.166426    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:23.217176 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.217143    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qw2q\" (UniqueName: \"kubernetes.io/projected/96b2ee0b-e508-4a91-9abb-543d0904fe6a-kube-api-access-5qw2q\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.217900 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.217865    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-metrics-certs\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.218162 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.218088    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2ee0b-e508-4a91-9abb-543d0904fe6a-openshift-service-ca\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.218346 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.218261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.218441 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:23:23.218420    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-serving-cert: secret "maas-api-e2e-mt-908a1435-serving-cert" not found
Sep 11 21:23:23.218676 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:23:23.218631    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls podName:96b2ee0b-e508-4a91-9abb-543d0904fe6a nodeName:}" failed. No retries permitted until 2026-09-11 21:23:23.718600556 +0000 UTC m=+1072.310113874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls") pod "maas-api-e2e-mt-908a1435-66f89768b-2tqww" (UID: "96b2ee0b-e508-4a91-9abb-543d0904fe6a") : secret "maas-api-e2e-mt-908a1435-serving-cert" not found
Sep 11 21:23:23.219621 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.219563    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2ee0b-e508-4a91-9abb-543d0904fe6a-openshift-service-ca\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.221693 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.221675    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-metrics-certs\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.225298 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.225276    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qw2q\" (UniqueName: \"kubernetes.io/projected/96b2ee0b-e508-4a91-9abb-543d0904fe6a-kube-api-access-5qw2q\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.399669 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.399563    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:23.723852 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.723741    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.724046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.724021    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:23.726214 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.726192    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls\") pod \"maas-api-e2e-mt-908a1435-66f89768b-2tqww\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:23.822225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.822190    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:23.980457 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:23.980366    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:24.023734 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.023702    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"]
Sep 11 21:23:24.023932 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.023905    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl" podUID="b18183f7-0d41-417b-9e0c-0ac33b79590d" containerName="maas-api" containerID="cri-o://ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8" gracePeriod=30
Sep 11 21:23:24.048188 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.047994    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:24.144764 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.144722    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:24.246460 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.246375    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:24.267702 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.267672    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"]
Sep 11 21:23:24.268512 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:23:24.268476    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96b2ee0b_e508_4a91_9abb_543d0904fe6a.slice/crio-f695d476e3a5d2dd2443b73366fea128b4842a6e7dcab4980455d9db304a5948 WatchSource:0}: Error finding container f695d476e3a5d2dd2443b73366fea128b4842a6e7dcab4980455d9db304a5948: Status 404 returned error can't find the container with id f695d476e3a5d2dd2443b73366fea128b4842a6e7dcab4980455d9db304a5948
Sep 11 21:23:24.306764 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.306739    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:23:24.328431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.328387    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:24.330389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.330362    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-metrics-certs\") pod \"b18183f7-0d41-417b-9e0c-0ac33b79590d\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") "
Sep 11 21:23:24.330521 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.330489    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wfms\" (UniqueName: \"kubernetes.io/projected/b18183f7-0d41-417b-9e0c-0ac33b79590d-kube-api-access-9wfms\") pod \"b18183f7-0d41-417b-9e0c-0ac33b79590d\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") "
Sep 11 21:23:24.330629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.330568    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18183f7-0d41-417b-9e0c-0ac33b79590d-openshift-service-ca\") pod \"b18183f7-0d41-417b-9e0c-0ac33b79590d\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") "
Sep 11 21:23:24.330629 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.330601    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-maas-api-tls\") pod \"b18183f7-0d41-417b-9e0c-0ac33b79590d\" (UID: \"b18183f7-0d41-417b-9e0c-0ac33b79590d\") "
Sep 11 21:23:24.331375 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.331345    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18183f7-0d41-417b-9e0c-0ac33b79590d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b18183f7-0d41-417b-9e0c-0ac33b79590d" (UID: "b18183f7-0d41-417b-9e0c-0ac33b79590d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:23:24.333390 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.333368    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b18183f7-0d41-417b-9e0c-0ac33b79590d" (UID: "b18183f7-0d41-417b-9e0c-0ac33b79590d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:23:24.333527 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.333444    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b18183f7-0d41-417b-9e0c-0ac33b79590d" (UID: "b18183f7-0d41-417b-9e0c-0ac33b79590d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:23:24.334326 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.334297    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18183f7-0d41-417b-9e0c-0ac33b79590d-kube-api-access-9wfms" (OuterVolumeSpecName: "kube-api-access-9wfms") pod "b18183f7-0d41-417b-9e0c-0ac33b79590d" (UID: "b18183f7-0d41-417b-9e0c-0ac33b79590d"). InnerVolumeSpecName "kube-api-access-9wfms". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:23:24.431969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.431930    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wfms\" (UniqueName: \"kubernetes.io/projected/b18183f7-0d41-417b-9e0c-0ac33b79590d-kube-api-access-9wfms\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:24.431969 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.431964    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18183f7-0d41-417b-9e0c-0ac33b79590d-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:24.432425 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.431977    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:24.432425 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.431989    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b18183f7-0d41-417b-9e0c-0ac33b79590d-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:23:24.605342 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.605308    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:24.865237 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.865150    2585 generic.go:356] "Generic (PLEG): container finished" podID="b18183f7-0d41-417b-9e0c-0ac33b79590d" containerID="ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8" exitCode=0
Sep 11 21:23:24.865237 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.865194    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"
Sep 11 21:23:24.865452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.865239    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl" event={"ID":"b18183f7-0d41-417b-9e0c-0ac33b79590d","Type":"ContainerDied","Data":"ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8"}
Sep 11 21:23:24.865452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.865297    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl" event={"ID":"b18183f7-0d41-417b-9e0c-0ac33b79590d","Type":"ContainerDied","Data":"26b8ce576f70783e18ab9759529ad42bd83c59bd98d9e86a23fb7cbd876c3030"}
Sep 11 21:23:24.865452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.865332    2585 scope.go:117] "RemoveContainer" containerID="ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8"
Sep 11 21:23:24.867187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.867153    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww" event={"ID":"96b2ee0b-e508-4a91-9abb-543d0904fe6a","Type":"ContainerStarted","Data":"e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810"}
Sep 11 21:23:24.867334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.867191    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww" event={"ID":"96b2ee0b-e508-4a91-9abb-543d0904fe6a","Type":"ContainerStarted","Data":"f695d476e3a5d2dd2443b73366fea128b4842a6e7dcab4980455d9db304a5948"}
Sep 11 21:23:24.867334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.867223    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:24.875607 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.875594    2585 scope.go:117] "RemoveContainer" containerID="ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8"
Sep 11 21:23:24.875898 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:23:24.875879    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8\": container with ID starting with ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8 not found: ID does not exist" containerID="ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8"
Sep 11 21:23:24.875966 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.875910    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8"} err="failed to get container status \"ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8\": rpc error: code = NotFound desc = could not find container \"ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8\": container with ID starting with ef5116b183142c1c74720722836ecbe06472d23d263b21a1f2e3d6e6d4f3fad8 not found: ID does not exist"
Sep 11 21:23:24.887803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.887767    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww" podStartSLOduration=1.448725239 podStartE2EDuration="1.887755377s" totalImagesPullingTime="439.030138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:23:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:23:24.88597729 +0000 UTC m=+1073.477490624" watchObservedRunningTime="2026-09-11 21:23:24.887755377 +0000 UTC m=+1073.479268700"
Sep 11 21:23:24.904544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.904523    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"]
Sep 11 21:23:24.908311 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.908292    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2b95f8-9f8fbc76-v2ttl"]
Sep 11 21:23:24.922998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:24.922974    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:25.755357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:25.755321    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:25.887152 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:25.887122    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18183f7-0d41-417b-9e0c-0ac33b79590d" path="/var/lib/kubelet/pods/b18183f7-0d41-417b-9e0c-0ac33b79590d/volumes"
Sep 11 21:23:26.574021 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:26.573989    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:27.116320 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:27.116282    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:27.171155 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:27.171127    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:27.262145 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:27.262112    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:30.470544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:30.470510    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:30.571285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:30.571249    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:30.709705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:30.709672    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:30.879824 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:30.879795    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:23:31.253280 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:31.253211    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:31.563902 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:31.563868    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:31.745312 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:31.745283    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:33.870158 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:33.870121    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:34.601284 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:34.601245    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:34.691298 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:34.691267    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:34.812401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:34.812364    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:35.710496 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:35.710463    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:36.487465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:36.487429    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:36.682974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:36.682936    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:37.158954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.158921    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"]
Sep 11 21:23:37.159553 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.159536    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18183f7-0d41-417b-9e0c-0ac33b79590d" containerName="maas-api"
Sep 11 21:23:37.159598 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.159556    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18183f7-0d41-417b-9e0c-0ac33b79590d" containerName="maas-api"
Sep 11 21:23:37.159715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.159700    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18183f7-0d41-417b-9e0c-0ac33b79590d" containerName="maas-api"
Sep 11 21:23:37.163303 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.163282    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.167099 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.167029    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-2bd772-serving-cert\""
Sep 11 21:23:37.174743 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.174720    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"]
Sep 11 21:23:37.194618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.194572    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:37.244357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.244335    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.244508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.244372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.244508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.244408    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b825f1-b5a9-4b3f-bfca-59c76164c40e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.244508 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.244436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cs9x\" (UniqueName: \"kubernetes.io/projected/31b825f1-b5a9-4b3f-bfca-59c76164c40e-kube-api-access-2cs9x\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.295973 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.295939    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:37.345903 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.345880    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.346028 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.345910    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.346028 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.345935    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b825f1-b5a9-4b3f-bfca-59c76164c40e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.346028 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:23:37.346016    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-serving-cert: secret "maas-api-e2e-shared-a-w3-2bd772-serving-cert" not found
Sep 11 21:23:37.346205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.346041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cs9x\" (UniqueName: \"kubernetes.io/projected/31b825f1-b5a9-4b3f-bfca-59c76164c40e-kube-api-access-2cs9x\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.346205 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:23:37.346073    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls podName:31b825f1-b5a9-4b3f-bfca-59c76164c40e nodeName:}" failed. No retries permitted until 2026-09-11 21:23:37.846058112 +0000 UTC m=+1086.437571418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls") pod "maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" (UID: "31b825f1-b5a9-4b3f-bfca-59c76164c40e") : secret "maas-api-e2e-shared-a-w3-2bd772-serving-cert" not found
Sep 11 21:23:37.346633 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.346616    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b825f1-b5a9-4b3f-bfca-59c76164c40e-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.348436 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.348416    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.354285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.354264    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cs9x\" (UniqueName: \"kubernetes.io/projected/31b825f1-b5a9-4b3f-bfca-59c76164c40e-kube-api-access-2cs9x\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.584680 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.584632    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:37.690956 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.690913    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:37.802912 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.802882    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:37.851328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.851265    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:37.853630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:37.853608    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:38.075782 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.075742    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:38.214146 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.214109    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:38.349328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.349303    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"]
Sep 11 21:23:38.350521 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:23:38.350492    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b825f1_b5a9_4b3f_bfca_59c76164c40e.slice/crio-85434fd778a9bd61c16ad31aef792033be58b44b385fe2cfad846bdda8fb92c6 WatchSource:0}: Error finding container 85434fd778a9bd61c16ad31aef792033be58b44b385fe2cfad846bdda8fb92c6: Status 404 returned error can't find the container with id 85434fd778a9bd61c16ad31aef792033be58b44b385fe2cfad846bdda8fb92c6
Sep 11 21:23:38.951056 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.951020    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" event={"ID":"31b825f1-b5a9-4b3f-bfca-59c76164c40e","Type":"ContainerStarted","Data":"3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9"}
Sep 11 21:23:38.951218 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.951080    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" event={"ID":"31b825f1-b5a9-4b3f-bfca-59c76164c40e","Type":"ContainerStarted","Data":"85434fd778a9bd61c16ad31aef792033be58b44b385fe2cfad846bdda8fb92c6"}
Sep 11 21:23:38.951264 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.951233    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:38.972583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:38.972536    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" podStartSLOduration=1.600961224 podStartE2EDuration="1.972522595s" totalImagesPullingTime="371.561371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:23:38.969697641 +0000 UTC m=+1087.561210961" watchObservedRunningTime="2026-09-11 21:23:38.972522595 +0000 UTC m=+1087.564035918"
Sep 11 21:23:39.183384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:39.183351    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:39.969363 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:39.969328    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.068299 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:40.068253    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:40.670199 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:40.670158    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:41.594555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:41.594517    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:43.214227 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:43.214182    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:44.123972 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:44.123943    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:44.963038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:44.963009    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:23:58.387365 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:58.387330    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:59.551283 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:59.551245    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:59.822102 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:59.822018    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:23:59.923412 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:23:59.923378    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:00.209431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:00.209341    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:00.680766 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:00.680737    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:00.777238 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:00.777206    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:01.511613 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:01.511578    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:02.286325 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:02.286268    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:03.347118 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:03.347085    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:03.595182 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:03.595139    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:03.706380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:03.706289    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:04.405942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:04.405910    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:05.181698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:05.181662    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:06.084295 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:06.084255    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:06.876387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:06.876355    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:07.655557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.655524    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"]
Sep 11 21:24:07.659267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.659244    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.661775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.661753    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-713791-serving-cert\""
Sep 11 21:24:07.670323 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.670295    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"]
Sep 11 21:24:07.690547 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.690521    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:07.713558 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.713531    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.713719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.713561    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfw6\" (UniqueName: \"kubernetes.io/projected/94fd769d-243a-4a1e-be74-b794f9f49a36-kube-api-access-jpfw6\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.713719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.713606    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94fd769d-243a-4a1e-be74-b794f9f49a36-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.713719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.713700    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.791734 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.791696    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:07.814730 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.814698    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.814918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.814822    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.814918 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.814851    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfw6\" (UniqueName: \"kubernetes.io/projected/94fd769d-243a-4a1e-be74-b794f9f49a36-kube-api-access-jpfw6\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.815038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.814939    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94fd769d-243a-4a1e-be74-b794f9f49a36-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.815038 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:24:07.814955    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-serving-cert: secret "maas-api-e2e-shared-b-w3-713791-serving-cert" not found
Sep 11 21:24:07.815038 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:24:07.815015    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls podName:94fd769d-243a-4a1e-be74-b794f9f49a36 nodeName:}" failed. No retries permitted until 2026-09-11 21:24:08.314999516 +0000 UTC m=+1116.906512817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls") pod "maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" (UID: "94fd769d-243a-4a1e-be74-b794f9f49a36") : secret "maas-api-e2e-shared-b-w3-713791-serving-cert" not found
Sep 11 21:24:07.815585 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.815562    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94fd769d-243a-4a1e-be74-b794f9f49a36-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.817082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.817064    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.823147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.823126    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfw6\" (UniqueName: \"kubernetes.io/projected/94fd769d-243a-4a1e-be74-b794f9f49a36-kube-api-access-jpfw6\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:07.895120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:07.895082    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:08.188370 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:08.188333    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:08.292352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:08.292315    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:08.321034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:08.321003    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:08.323410 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:08.323344    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:08.571935 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:08.571898    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:08.850365 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:08.850319    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"]
Sep 11 21:24:08.851793 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:24:08.851764    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94fd769d_243a_4a1e_be74_b794f9f49a36.slice/crio-a9567c5344be2734dbb28a3d5283a4bb9cb271460b56a654ae57e33f1db7689d WatchSource:0}: Error finding container a9567c5344be2734dbb28a3d5283a4bb9cb271460b56a654ae57e33f1db7689d: Status 404 returned error can't find the container with id a9567c5344be2734dbb28a3d5283a4bb9cb271460b56a654ae57e33f1db7689d
Sep 11 21:24:09.126367 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:09.126249    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" event={"ID":"94fd769d-243a-4a1e-be74-b794f9f49a36","Type":"ContainerStarted","Data":"a9567c5344be2734dbb28a3d5283a4bb9cb271460b56a654ae57e33f1db7689d"}
Sep 11 21:24:10.134305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:10.134268    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" event={"ID":"94fd769d-243a-4a1e-be74-b794f9f49a36","Type":"ContainerStarted","Data":"a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f"}
Sep 11 21:24:10.134703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:10.134355    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:10.154583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:10.154537    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" podStartSLOduration=2.809238835 podStartE2EDuration="3.154524273s" totalImagesPullingTime="345.285438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:24:10.152493373 +0000 UTC m=+1118.744006696" watchObservedRunningTime="2026-09-11 21:24:10.154524273 +0000 UTC m=+1118.746037647"
Sep 11 21:24:15.139310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:15.139257    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:16.146308 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:16.146280    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:24:30.424287 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:30.424247    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:31.197524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:31.197491    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:31.983272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:31.983215    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:32.842347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:32.842310    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:33.740476 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:33.740440    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:33.946054 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:33.946024    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:34.776870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:34.776831    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:35.139440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:35.139408    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:40.398220 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:40.398191    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:41.204462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:41.204428    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:41.915323 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:41.915290    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:42.696913 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:42.696870    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:43.607875 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:43.607832    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:44.358359 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:44.358319    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:45.152267 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:45.152232    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:47.709360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:47.709312    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:50.218265 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:50.218208    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:52.750820 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:52.750782    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:55.982293 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:55.982203    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"]
Sep 11 21:24:55.982894 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:55.982823    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww" podUID="96b2ee0b-e508-4a91-9abb-543d0904fe6a" containerName="maas-api" containerID="cri-o://e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810" gracePeriod=30
Sep 11 21:24:55.997679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:55.997631    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.100559 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.100527    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.202766 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.202731    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.247046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.246991    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:24:56.271702 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.271669    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.415003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.414971    2585 generic.go:356] "Generic (PLEG): container finished" podID="96b2ee0b-e508-4a91-9abb-543d0904fe6a" containerID="e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810" exitCode=0
Sep 11 21:24:56.415184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.415019    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"
Sep 11 21:24:56.415184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.415065    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww" event={"ID":"96b2ee0b-e508-4a91-9abb-543d0904fe6a","Type":"ContainerDied","Data":"e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810"}
Sep 11 21:24:56.415184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.415126    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww" event={"ID":"96b2ee0b-e508-4a91-9abb-543d0904fe6a","Type":"ContainerDied","Data":"f695d476e3a5d2dd2443b73366fea128b4842a6e7dcab4980455d9db304a5948"}
Sep 11 21:24:56.415184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.415161    2585 scope.go:117] "RemoveContainer" containerID="e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810"
Sep 11 21:24:56.418722 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.418631    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls\") pod \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") "
Sep 11 21:24:56.418832 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.418780    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-metrics-certs\") pod \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") "
Sep 11 21:24:56.418900 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.418840    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2ee0b-e508-4a91-9abb-543d0904fe6a-openshift-service-ca\") pod \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") "
Sep 11 21:24:56.418965 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.418926    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qw2q\" (UniqueName: \"kubernetes.io/projected/96b2ee0b-e508-4a91-9abb-543d0904fe6a-kube-api-access-5qw2q\") pod \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\" (UID: \"96b2ee0b-e508-4a91-9abb-543d0904fe6a\") "
Sep 11 21:24:56.419560 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.419511    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96b2ee0b-e508-4a91-9abb-543d0904fe6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96b2ee0b-e508-4a91-9abb-543d0904fe6a" (UID: "96b2ee0b-e508-4a91-9abb-543d0904fe6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:24:56.421187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.421157    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96b2ee0b-e508-4a91-9abb-543d0904fe6a" (UID: "96b2ee0b-e508-4a91-9abb-543d0904fe6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:24:56.421297 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.421204    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "96b2ee0b-e508-4a91-9abb-543d0904fe6a" (UID: "96b2ee0b-e508-4a91-9abb-543d0904fe6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:24:56.421674 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.421616    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96b2ee0b-e508-4a91-9abb-543d0904fe6a-kube-api-access-5qw2q" (OuterVolumeSpecName: "kube-api-access-5qw2q") pod "96b2ee0b-e508-4a91-9abb-543d0904fe6a" (UID: "96b2ee0b-e508-4a91-9abb-543d0904fe6a"). InnerVolumeSpecName "kube-api-access-5qw2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:24:56.425968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.425948    2585 scope.go:117] "RemoveContainer" containerID="e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810"
Sep 11 21:24:56.426257 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:24:56.426238    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810\": container with ID starting with e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810 not found: ID does not exist" containerID="e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810"
Sep 11 21:24:56.426305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.426264    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810"} err="failed to get container status \"e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810\": rpc error: code = NotFound desc = could not find container \"e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810\": container with ID starting with e0bfebcad9fd7bbb7c3437178daa576dee2329daf1c25e376d81d12175176810 not found: ID does not exist"
Sep 11 21:24:56.520382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.520305    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qw2q\" (UniqueName: \"kubernetes.io/projected/96b2ee0b-e508-4a91-9abb-543d0904fe6a-kube-api-access-5qw2q\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:24:56.520382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.520331    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:24:56.520382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.520340    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/96b2ee0b-e508-4a91-9abb-543d0904fe6a-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:24:56.520382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.520349    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96b2ee0b-e508-4a91-9abb-543d0904fe6a-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:24:56.651895 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.651862    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:56.740399 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.740371    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"]
Sep 11 21:24:56.755854 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:56.755827    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-908a1435-66f89768b-2tqww"]
Sep 11 21:24:57.417954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:57.417904    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:57.887014 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:57.886985    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96b2ee0b-e508-4a91-9abb-543d0904fe6a" path="/var/lib/kubelet/pods/96b2ee0b-e508-4a91-9abb-543d0904fe6a/volumes"
Sep 11 21:24:58.267698 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:58.267587    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:59.063111 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:59.063082    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:59.432838 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:59.432759    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:24:59.769990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:24:59.769914    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:04.517489 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:04.517458    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:18.047445 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:18.047400    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:31.957489 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:31.957458    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:25:31.959542 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:31.959521    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:25:31.962697 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:31.962678    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:25:31.964704 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:31.964684    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:25:35.031214 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:35.031173    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:40.872855 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:40.872813    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:42.034609 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:42.034571    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:25:48.035012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:25:48.034975    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:02.233339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:02.233304    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:03.316696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:03.316626    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:03.755632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:03.755518    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:03.849581 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:03.849543    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:03.950486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:03.950452    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:04.567989 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:04.567946    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:04.650742 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:04.650704    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:04.753066 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:04.753027    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:06.105713 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:06.105678    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:11.967851 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:11.967813    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:12.074328 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:12.074276    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:12.664071 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:12.664033    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:18.936803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:18.936759    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:19.199799 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:19.199704    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:19.535382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:19.535345    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:29.686677 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:29.686567    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:29.928708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:29.928671    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:50.894348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:50.894303    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:57.140047 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:57.140010    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:57.247790 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:57.247752    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:57.501175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:57.501086    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:57.851855 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:57.851823    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:26:58.561980 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:26:58.561949    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:00.101185 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:00.101148    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:00.790852 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:00.790818    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:00.944477 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:00.944445    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:01.342860 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:01.342824    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:02.779915 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:02.779876    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:03.767873 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:03.767839    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:04.742484 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:04.742454    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:05.865701 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.865666    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"]
Sep 11 21:27:05.866401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.866380    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96b2ee0b-e508-4a91-9abb-543d0904fe6a" containerName="maas-api"
Sep 11 21:27:05.866454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.866406    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="96b2ee0b-e508-4a91-9abb-543d0904fe6a" containerName="maas-api"
Sep 11 21:27:05.866537 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.866526    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="96b2ee0b-e508-4a91-9abb-543d0904fe6a" containerName="maas-api"
Sep 11 21:27:05.870323 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.870301    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:05.875073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.875052    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-354c80-serving-cert\""
Sep 11 21:27:05.889443 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.889418    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"]
Sep 11 21:27:05.928540 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:05.928511    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:06.009044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.009000    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-maas-api-tls\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.009044 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.009047    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-metrics-certs\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.009266 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.009071    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtljk\" (UniqueName: \"kubernetes.io/projected/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-kube-api-access-rtljk\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.009266 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.009235    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-openshift-service-ca\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.026814 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.026782    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:06.109955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.109918    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-maas-api-tls\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.109955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.109959    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-metrics-certs\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.110156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.109993    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtljk\" (UniqueName: \"kubernetes.io/projected/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-kube-api-access-rtljk\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.110156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.110132    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-openshift-service-ca\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.110807 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.110785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-openshift-service-ca\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.112407 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.112383    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-metrics-certs\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.112556 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.112536    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-maas-api-tls\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.119414 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.119357    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtljk\" (UniqueName: \"kubernetes.io/projected/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-kube-api-access-rtljk\") pod \"maas-api-e2e-api-a-354c80-56564f7c-n6qtk\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.127214 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.127189    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:06.184658 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.184619    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:06.466779 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.466754    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"]
Sep 11 21:27:06.468093 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:27:06.468068    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7b4c062_4a4f_45f0_9d0c_64b71ddd1a29.slice/crio-3d92af49781d818c32ea1b3f176b7e37a95e2234ed4fe7b43e9c99c5c105f768 WatchSource:0}: Error finding container 3d92af49781d818c32ea1b3f176b7e37a95e2234ed4fe7b43e9c99c5c105f768: Status 404 returned error can't find the container with id 3d92af49781d818c32ea1b3f176b7e37a95e2234ed4fe7b43e9c99c5c105f768
Sep 11 21:27:06.483334 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.483311    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:06.686240 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:06.686209    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:07.180363 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:07.180278    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk" event={"ID":"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29","Type":"ContainerStarted","Data":"a86e12d4eb1687b87f2f00eb34daddb5ddfdb22cd0d1d78752f54d27464b5151"}
Sep 11 21:27:07.180363 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:07.180329    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk" event={"ID":"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29","Type":"ContainerStarted","Data":"3d92af49781d818c32ea1b3f176b7e37a95e2234ed4fe7b43e9c99c5c105f768"}
Sep 11 21:27:07.180811 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:07.180417    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:07.201727 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:07.201683    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk" podStartSLOduration=1.74202448 podStartE2EDuration="2.20166838s" totalImagesPullingTime="459.6439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:27:07.199067552 +0000 UTC m=+1295.790580875" watchObservedRunningTime="2026-09-11 21:27:07.20166838 +0000 UTC m=+1295.793181704"
Sep 11 21:27:13.192147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:13.192112    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:27:28.610387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:28.610347    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:29.740029 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:29.739993    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:30.985333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:30.985298    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:31.100382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:31.100346    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:31.439242 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:31.439209    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:31.829599 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:31.829558    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:32.013357 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:32.013325    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:32.059791 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:32.059759    2585 scope.go:117] "RemoveContainer" containerID="e62f52cf2ac77c95a44d6265d59946a1b6ad3a238af720b999c922ddf9c12874"
Sep 11 21:27:32.245427 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:32.245392    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:33.490234 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:33.490199    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:34.638728 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:34.638690    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:34.897899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:34.897810    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:35.119372 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:35.119333    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:35.292391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:35.292358    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:36.262995 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:36.262957    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:36.460562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:36.460528    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:37.334934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:37.334898    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:38.453768 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:38.453728    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:39.595953 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:39.595918    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:40.583209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:40.583178    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:41.502668 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.502619    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"]
Sep 11 21:27:41.507461 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.507440    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.516314 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.516294    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-2748c5-serving-cert\""
Sep 11 21:27:41.522043 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.522019    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"]
Sep 11 21:27:41.561142 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.561095    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:41.631956 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.631921    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b64d340-45a0-4fd1-87b7-dce188e2cd86-openshift-service-ca\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.632171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.631990    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-metrics-certs\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.632171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.632102    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7wd7\" (UniqueName: \"kubernetes.io/projected/6b64d340-45a0-4fd1-87b7-dce188e2cd86-kube-api-access-g7wd7\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.632171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.632132    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.660121 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.660084    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:41.733162 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.733124    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-metrics-certs\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.733335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.733183    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7wd7\" (UniqueName: \"kubernetes.io/projected/6b64d340-45a0-4fd1-87b7-dce188e2cd86-kube-api-access-g7wd7\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.733335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.733202    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.733335 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.733243    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b64d340-45a0-4fd1-87b7-dce188e2cd86-openshift-service-ca\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.733448 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:27:41.733352    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-serving-cert: secret "maas-api-e2e-api-b-2748c5-serving-cert" not found
Sep 11 21:27:41.733448 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:27:41.733435    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls podName:6b64d340-45a0-4fd1-87b7-dce188e2cd86 nodeName:}" failed. No retries permitted until 2026-09-11 21:27:42.233414762 +0000 UTC m=+1330.824928071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls") pod "maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" (UID: "6b64d340-45a0-4fd1-87b7-dce188e2cd86") : secret "maas-api-e2e-api-b-2748c5-serving-cert" not found
Sep 11 21:27:41.734034 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.734006    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b64d340-45a0-4fd1-87b7-dce188e2cd86-openshift-service-ca\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.735574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.735553    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-metrics-certs\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:41.748440 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:41.748417    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7wd7\" (UniqueName: \"kubernetes.io/projected/6b64d340-45a0-4fd1-87b7-dce188e2cd86-kube-api-access-g7wd7\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:42.096711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.096673    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:42.239027 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.238993    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:42.241485 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.241451    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls\") pod \"maas-api-e2e-api-b-2748c5-b97674b98-gwvxx\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:42.373510 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.373407    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:42.418353 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.418313    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:42.487616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.487534    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:42.728904 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.728870    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"]
Sep 11 21:27:42.730060 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:27:42.730026    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b64d340_45a0_4fd1_87b7_dce188e2cd86.slice/crio-9aa9b249318f5d2ac31106f364bdf9a9fd03b5387a337360e404008de3727527 WatchSource:0}: Error finding container 9aa9b249318f5d2ac31106f364bdf9a9fd03b5387a337360e404008de3727527: Status 404 returned error can't find the container with id 9aa9b249318f5d2ac31106f364bdf9a9fd03b5387a337360e404008de3727527
Sep 11 21:27:42.732293 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:42.732263    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:27:43.388857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:43.388766    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" event={"ID":"6b64d340-45a0-4fd1-87b7-dce188e2cd86","Type":"ContainerStarted","Data":"6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00"}
Sep 11 21:27:43.388857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:43.388835    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:27:43.389035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:43.388859    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" event={"ID":"6b64d340-45a0-4fd1-87b7-dce188e2cd86","Type":"ContainerStarted","Data":"9aa9b249318f5d2ac31106f364bdf9a9fd03b5387a337360e404008de3727527"}
Sep 11 21:27:43.423017 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:43.422963    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" podStartSLOduration=2.052849214 podStartE2EDuration="2.422948067s" totalImagesPullingTime="370.098853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:27:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:27:43.421174922 +0000 UTC m=+1332.012688244" watchObservedRunningTime="2026-09-11 21:27:43.422948067 +0000 UTC m=+1332.014461429"
Sep 11 21:27:47.349897 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:47.349860    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:48.065659 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:48.065609    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:27:49.401214 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:27:49.401182    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:28:02.996804 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:02.996715    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:04.556839 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:04.556795    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:05.147763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:05.147730    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:05.800179 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:05.800139    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:06.982010 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:06.981976    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:08.218562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:08.218515    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:09.383347 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:09.383312    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:10.744005 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:10.743971    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:11.886828 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:11.886788    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:13.105053 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:13.105014    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:14.354025 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:14.353985    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:15.519618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:15.519584    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:16.791516 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:16.791479    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:18.291438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:18.291401    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:20.534898 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:20.534854    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:20.692677 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:20.692617    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:24.388245 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.388210    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"]
Sep 11 21:28:24.388679 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.388414    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk" podUID="c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" containerName="maas-api" containerID="cri-o://a86e12d4eb1687b87f2f00eb34daddb5ddfdb22cd0d1d78752f54d27464b5151" gracePeriod=30
Sep 11 21:28:24.457557 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.457532    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:24.645971 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.645893    2585 generic.go:356] "Generic (PLEG): container finished" podID="c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" containerID="a86e12d4eb1687b87f2f00eb34daddb5ddfdb22cd0d1d78752f54d27464b5151" exitCode=0
Sep 11 21:28:24.646084 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.645970    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk" event={"ID":"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29","Type":"ContainerDied","Data":"a86e12d4eb1687b87f2f00eb34daddb5ddfdb22cd0d1d78752f54d27464b5151"}
Sep 11 21:28:24.646084 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.646021    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk" event={"ID":"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29","Type":"ContainerDied","Data":"3d92af49781d818c32ea1b3f176b7e37a95e2234ed4fe7b43e9c99c5c105f768"}
Sep 11 21:28:24.646084 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.646045    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d92af49781d818c32ea1b3f176b7e37a95e2234ed4fe7b43e9c99c5c105f768"
Sep 11 21:28:24.653191 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.653165    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:24.653521 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.653505    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:28:24.717813 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.717792    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtljk\" (UniqueName: \"kubernetes.io/projected/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-kube-api-access-rtljk\") pod \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") "
Sep 11 21:28:24.717952 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.717858    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-metrics-certs\") pod \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") "
Sep 11 21:28:24.717952 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.717896    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-maas-api-tls\") pod \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") "
Sep 11 21:28:24.717952 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.717930    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-openshift-service-ca\") pod \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\" (UID: \"c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29\") "
Sep 11 21:28:24.718431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.718406    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" (UID: "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:28:24.720110 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.720087    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" (UID: "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:28:24.720351 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.720321    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" (UID: "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:28:24.720351 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.720339    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-kube-api-access-rtljk" (OuterVolumeSpecName: "kube-api-access-rtljk") pod "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" (UID: "c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29"). InnerVolumeSpecName "kube-api-access-rtljk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:28:24.819396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.819371    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtljk\" (UniqueName: \"kubernetes.io/projected/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-kube-api-access-rtljk\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:24.819396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.819392    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:24.819396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.819401    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:24.819589 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.819409    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:24.820968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:24.820942    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:25.003346 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.003264    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:25.143886 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.143852    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:25.487945 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.487907    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:25.652512 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.652483    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"
Sep 11 21:28:25.694731 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.694710    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"]
Sep 11 21:28:25.705164 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.705141    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-354c80-56564f7c-n6qtk"]
Sep 11 21:28:25.886778 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:25.886751    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" path="/var/lib/kubelet/pods/c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29/volumes"
Sep 11 21:28:26.341341 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:26.341309    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:27.727283 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:27.727250    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:27.910122 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:27.910083    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:29.282326 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:29.282291    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:30.555246 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:30.555210    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:31.772196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:31.772159    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:34.300065 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:34.300023    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:34.438117 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:34.438082    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:34.615268 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:34.615189    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:35.066660 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:35.066605    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:36.395948 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:36.395895    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:37.473967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:37.473928    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:38.505817 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:38.505789    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:39.597161 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:39.597116    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:40.734572 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:40.734537    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:41.817934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:41.817890    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:50.794977 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:50.794943    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"]
Sep 11 21:28:50.795374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:50.795150    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" podUID="6b64d340-45a0-4fd1-87b7-dce188e2cd86" containerName="maas-api" containerID="cri-o://6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00" gracePeriod=30
Sep 11 21:28:50.836986 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:50.836936    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:50.966117 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:50.966078    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:51.059178 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.059120    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:28:51.059555 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.059526    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:51.142970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.142925    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-metrics-certs\") pod \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") "
Sep 11 21:28:51.142970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.142974    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7wd7\" (UniqueName: \"kubernetes.io/projected/6b64d340-45a0-4fd1-87b7-dce188e2cd86-kube-api-access-g7wd7\") pod \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") "
Sep 11 21:28:51.143325 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.143090    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls\") pod \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") "
Sep 11 21:28:51.143325 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.143129    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b64d340-45a0-4fd1-87b7-dce188e2cd86-openshift-service-ca\") pod \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\" (UID: \"6b64d340-45a0-4fd1-87b7-dce188e2cd86\") "
Sep 11 21:28:51.143494 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.143463    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b64d340-45a0-4fd1-87b7-dce188e2cd86-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b64d340-45a0-4fd1-87b7-dce188e2cd86" (UID: "6b64d340-45a0-4fd1-87b7-dce188e2cd86"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:28:51.145309 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.145251    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b64d340-45a0-4fd1-87b7-dce188e2cd86-kube-api-access-g7wd7" (OuterVolumeSpecName: "kube-api-access-g7wd7") pod "6b64d340-45a0-4fd1-87b7-dce188e2cd86" (UID: "6b64d340-45a0-4fd1-87b7-dce188e2cd86"). InnerVolumeSpecName "kube-api-access-g7wd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:28:51.145431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.145319    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b64d340-45a0-4fd1-87b7-dce188e2cd86" (UID: "6b64d340-45a0-4fd1-87b7-dce188e2cd86"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:28:51.145431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.145398    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6b64d340-45a0-4fd1-87b7-dce188e2cd86" (UID: "6b64d340-45a0-4fd1-87b7-dce188e2cd86"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:28:51.186361 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.186332    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:51.244093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.244048    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:51.244093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.244088    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7wd7\" (UniqueName: \"kubernetes.io/projected/6b64d340-45a0-4fd1-87b7-dce188e2cd86-kube-api-access-g7wd7\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:51.244093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.244099    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b64d340-45a0-4fd1-87b7-dce188e2cd86-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:51.244093 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.244108    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b64d340-45a0-4fd1-87b7-dce188e2cd86-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:28:51.324173 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.324102    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:51.579583 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.579494    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:51.739939 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.739911    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:51.818340 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.818301    2585 generic.go:356] "Generic (PLEG): container finished" podID="6b64d340-45a0-4fd1-87b7-dce188e2cd86" containerID="6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00" exitCode=0
Sep 11 21:28:51.818772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.818343    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"
Sep 11 21:28:51.818772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.818356    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" event={"ID":"6b64d340-45a0-4fd1-87b7-dce188e2cd86","Type":"ContainerDied","Data":"6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00"}
Sep 11 21:28:51.818772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.818410    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx" event={"ID":"6b64d340-45a0-4fd1-87b7-dce188e2cd86","Type":"ContainerDied","Data":"9aa9b249318f5d2ac31106f364bdf9a9fd03b5387a337360e404008de3727527"}
Sep 11 21:28:51.818772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.818436    2585 scope.go:117] "RemoveContainer" containerID="6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00"
Sep 11 21:28:51.829038 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.829018    2585 scope.go:117] "RemoveContainer" containerID="6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00"
Sep 11 21:28:51.829290 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:28:51.829272    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00\": container with ID starting with 6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00 not found: ID does not exist" containerID="6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00"
Sep 11 21:28:51.829338 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.829299    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00"} err="failed to get container status \"6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00\": rpc error: code = NotFound desc = could not find container \"6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00\": container with ID starting with 6cc6f7e485dedf729b55b0cc9f43573d42650ea8e048bed1d78224a06a59cb00 not found: ID does not exist"
Sep 11 21:28:51.850563 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.850504    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"]
Sep 11 21:28:51.854967 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.854945    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-2748c5-b97674b98-gwvxx"]
Sep 11 21:28:51.886733 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:51.886712    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b64d340-45a0-4fd1-87b7-dce188e2cd86" path="/var/lib/kubelet/pods/6b64d340-45a0-4fd1-87b7-dce188e2cd86/volumes"
Sep 11 21:28:52.696927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:52.696894    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:54.179103 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:54.179061    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:55.151805 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:55.151777    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:56.140315 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:56.140284    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:59.280634 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:59.280603    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:59.425296 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:59.425260    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:28:59.730708 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:28:59.730672    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:00.978623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:00.978582    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:02.439719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:02.439681    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:03.637198 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:03.637165    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:03.803017 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:03.802981    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:04.792615 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:04.792578    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:05.900700 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:05.900661    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:10.375892 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:10.375860    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.190569 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.190533    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"]
Sep 11 21:29:11.190774 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.190751    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" podUID="8ce5100e-e484-400f-b6d6-80e809eb373e" containerName="maas-api" containerID="cri-o://6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e" gracePeriod=30
Sep 11 21:29:11.231204 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.231170    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.328595 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.328563    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.429784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.429761    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:29:11.434268 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.434241    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.500137 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.500051    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce5100e-e484-400f-b6d6-80e809eb373e-openshift-service-ca\") pod \"8ce5100e-e484-400f-b6d6-80e809eb373e\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") "
Sep 11 21:29:11.500137 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.500096    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-metrics-certs\") pod \"8ce5100e-e484-400f-b6d6-80e809eb373e\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") "
Sep 11 21:29:11.500137 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.500127    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgfxc\" (UniqueName: \"kubernetes.io/projected/8ce5100e-e484-400f-b6d6-80e809eb373e-kube-api-access-hgfxc\") pod \"8ce5100e-e484-400f-b6d6-80e809eb373e\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") "
Sep 11 21:29:11.500417 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.500198    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls\") pod \"8ce5100e-e484-400f-b6d6-80e809eb373e\" (UID: \"8ce5100e-e484-400f-b6d6-80e809eb373e\") "
Sep 11 21:29:11.500474 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.500437    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce5100e-e484-400f-b6d6-80e809eb373e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ce5100e-e484-400f-b6d6-80e809eb373e" (UID: "8ce5100e-e484-400f-b6d6-80e809eb373e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:11.500565 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.500545    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ce5100e-e484-400f-b6d6-80e809eb373e-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:11.502475 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.502445    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce5100e-e484-400f-b6d6-80e809eb373e-kube-api-access-hgfxc" (OuterVolumeSpecName: "kube-api-access-hgfxc") pod "8ce5100e-e484-400f-b6d6-80e809eb373e" (UID: "8ce5100e-e484-400f-b6d6-80e809eb373e"). InnerVolumeSpecName "kube-api-access-hgfxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:11.502722 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.502701    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8ce5100e-e484-400f-b6d6-80e809eb373e" (UID: "8ce5100e-e484-400f-b6d6-80e809eb373e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:29:11.503278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.503255    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ce5100e-e484-400f-b6d6-80e809eb373e" (UID: "8ce5100e-e484-400f-b6d6-80e809eb373e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:29:11.552281 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.552250    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.601074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.601044    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:11.601074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.601070    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgfxc\" (UniqueName: \"kubernetes.io/projected/8ce5100e-e484-400f-b6d6-80e809eb373e-kube-api-access-hgfxc\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:11.601074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.601079    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ce5100e-e484-400f-b6d6-80e809eb373e-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:11.704611 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.704561    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.938035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.938007    2585 generic.go:356] "Generic (PLEG): container finished" podID="8ce5100e-e484-400f-b6d6-80e809eb373e" containerID="6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e" exitCode=0
Sep 11 21:29:11.938187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.938051    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"
Sep 11 21:29:11.938187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.938080    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" event={"ID":"8ce5100e-e484-400f-b6d6-80e809eb373e","Type":"ContainerDied","Data":"6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e"}
Sep 11 21:29:11.938187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.938128    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t" event={"ID":"8ce5100e-e484-400f-b6d6-80e809eb373e","Type":"ContainerDied","Data":"9cb8b44c060e95473399ee564aed780f12f0cfda663e6c2cf86609888e1fd7ff"}
Sep 11 21:29:11.938187 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.938151    2585 scope.go:117] "RemoveContainer" containerID="6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e"
Sep 11 21:29:11.945003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.944979    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:11.947382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.947367    2585 scope.go:117] "RemoveContainer" containerID="6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e"
Sep 11 21:29:11.947665 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:29:11.947632    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e\": container with ID starting with 6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e not found: ID does not exist" containerID="6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e"
Sep 11 21:29:11.947716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.947672    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e"} err="failed to get container status \"6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e\": rpc error: code = NotFound desc = could not find container \"6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e\": container with ID starting with 6501a34ee34ee663d34b23c26e4db75acdcbf813b3c1a8231436289ae6d3615e not found: ID does not exist"
Sep 11 21:29:11.962403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.962378    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"]
Sep 11 21:29:11.968028 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:11.968009    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1117b2-74877d7cfc-kht6t"]
Sep 11 21:29:12.350719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:12.350690    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:13.698234 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:13.698194    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:13.888101 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:13.888069    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce5100e-e484-400f-b6d6-80e809eb373e" path="/var/lib/kubelet/pods/8ce5100e-e484-400f-b6d6-80e809eb373e/volumes"
Sep 11 21:29:15.087657 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:15.087596    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:16.136498 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:16.136462    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:18.959111 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:18.959064    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:19.136665 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:19.136610    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:19.343387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:19.343355    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:20.085249 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:20.085217    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:22.402597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:22.402560    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:23.578754 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:23.578720    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:24.889935 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:24.889853    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:26.471456 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:26.471413    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:29.671682 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:29.671628    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:30.603955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.603918    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"]
Sep 11 21:29:30.604125 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.604095    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd" podUID="4f4fb91b-35ed-4907-9c9f-b7c5c936434d" containerName="maas-api" containerID="cri-o://4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f" gracePeriod=30
Sep 11 21:29:30.659869 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.659841    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:30.787493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.787432    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:30.854089 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.854032    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:29:30.887893 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.887855    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:30.962467 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.962436    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-metrics-certs\") pod \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") "
Sep 11 21:29:30.962600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.962491    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-maas-api-tls\") pod \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") "
Sep 11 21:29:30.962600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.962523    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-openshift-service-ca\") pod \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") "
Sep 11 21:29:30.962600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.962556    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ftbr\" (UniqueName: \"kubernetes.io/projected/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-kube-api-access-6ftbr\") pod \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\" (UID: \"4f4fb91b-35ed-4907-9c9f-b7c5c936434d\") "
Sep 11 21:29:30.962932 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.962902    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4f4fb91b-35ed-4907-9c9f-b7c5c936434d" (UID: "4f4fb91b-35ed-4907-9c9f-b7c5c936434d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:29:30.964716 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.964686    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4f4fb91b-35ed-4907-9c9f-b7c5c936434d" (UID: "4f4fb91b-35ed-4907-9c9f-b7c5c936434d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:29:30.964802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.964728    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-kube-api-access-6ftbr" (OuterVolumeSpecName: "kube-api-access-6ftbr") pod "4f4fb91b-35ed-4907-9c9f-b7c5c936434d" (UID: "4f4fb91b-35ed-4907-9c9f-b7c5c936434d"). InnerVolumeSpecName "kube-api-access-6ftbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:29:30.964802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:30.964759    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4f4fb91b-35ed-4907-9c9f-b7c5c936434d" (UID: "4f4fb91b-35ed-4907-9c9f-b7c5c936434d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:29:31.006632 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.006602    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.055596 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.055569    2585 generic.go:356] "Generic (PLEG): container finished" podID="4f4fb91b-35ed-4907-9c9f-b7c5c936434d" containerID="4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f" exitCode=0
Sep 11 21:29:31.055841 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.055612    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"
Sep 11 21:29:31.055841 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.055683    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd" event={"ID":"4f4fb91b-35ed-4907-9c9f-b7c5c936434d","Type":"ContainerDied","Data":"4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f"}
Sep 11 21:29:31.055841 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.055738    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd" event={"ID":"4f4fb91b-35ed-4907-9c9f-b7c5c936434d","Type":"ContainerDied","Data":"232f67d14e05f4a43987aca846d552e54bc8fa0edccd64729bd3b9af7d95c0ba"}
Sep 11 21:29:31.055841 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.055764    2585 scope.go:117] "RemoveContainer" containerID="4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f"
Sep 11 21:29:31.063316 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.063246    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ftbr\" (UniqueName: \"kubernetes.io/projected/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-kube-api-access-6ftbr\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.063430 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.063308    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.063430 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.063335    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.063430 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.063347    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f4fb91b-35ed-4907-9c9f-b7c5c936434d-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:29:31.068484 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.068464    2585 scope.go:117] "RemoveContainer" containerID="4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f"
Sep 11 21:29:31.068893 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:29:31.068873    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f\": container with ID starting with 4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f not found: ID does not exist" containerID="4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f"
Sep 11 21:29:31.068970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.068902    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f"} err="failed to get container status \"4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f\": rpc error: code = NotFound desc = could not find container \"4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f\": container with ID starting with 4d635f82b6dd1c45d74be982fc30df90c33f28133f186566ce0aafae21e20a9f not found: ID does not exist"
Sep 11 21:29:31.084087 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.084052    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"]
Sep 11 21:29:31.089661 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.089620    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-55fb09-c76c5d955-944bd"]
Sep 11 21:29:31.097212 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.097185    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.356552 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.356511    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.489285 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.489254    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:31.886959 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:31.886919    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f4fb91b-35ed-4907-9c9f-b7c5c936434d" path="/var/lib/kubelet/pods/4f4fb91b-35ed-4907-9c9f-b7c5c936434d/volumes"
Sep 11 21:29:32.646112 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:32.646080    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:32.822409 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:32.822369    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:33.809377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:33.809344    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:34.119752 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:34.119660    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:38.695693 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:38.695634    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:38.814805 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:38.814748    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:39.080366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:39.080337    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:47.903253 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:47.903209    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:29:48.651584 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:29:48.651549    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:07.300387 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:07.300347    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:21.565810 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:21.565776    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:32.002391 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:32.002361    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:30:32.008119 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:32.008098    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:30:32.008450 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:32.008427    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:30:32.013393 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:32.013378    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:30:49.482230 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:49.482194    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:50.880786 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:50.880754    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:51.852535 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:51.852496    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:52.332848 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:52.332792    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:52.623788 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:52.623693    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:52.763544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:52.763507    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:56.240696 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:56.240604    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:56.361825 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:56.361777    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:57.507209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:57.507180    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:58.466486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466451    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"]
Sep 11 21:30:58.466889 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466873    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce5100e-e484-400f-b6d6-80e809eb373e" containerName="maas-api"
Sep 11 21:30:58.466889 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466889    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce5100e-e484-400f-b6d6-80e809eb373e" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466901    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f4fb91b-35ed-4907-9c9f-b7c5c936434d" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466906    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f4fb91b-35ed-4907-9c9f-b7c5c936434d" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466915    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b64d340-45a0-4fd1-87b7-dce188e2cd86" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466921    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b64d340-45a0-4fd1-87b7-dce188e2cd86" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466945    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.466950    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.467012    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7b4c062-4a4f-45f0-9d0c-64b71ddd1a29" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.467019    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f4fb91b-35ed-4907-9c9f-b7c5c936434d" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.467025    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce5100e-e484-400f-b6d6-80e809eb373e" containerName="maas-api"
Sep 11 21:30:58.467070 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.467034    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b64d340-45a0-4fd1-87b7-dce188e2cd86" containerName="maas-api"
Sep 11 21:30:58.470141 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.470120    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.473205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.473186    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-19ce3e-serving-cert\""
Sep 11 21:30:58.484007 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.483985    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"]
Sep 11 21:30:58.506124 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.506098    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:58.581780 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.581752    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80210e46-193c-479c-a32b-59e3804f41ea-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.582160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.581798    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-metrics-certs\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.582160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.581886    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bk7\" (UniqueName: \"kubernetes.io/projected/80210e46-193c-479c-a32b-59e3804f41ea-kube-api-access-49bk7\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.582160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.581926    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.609663 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.609590    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:58.683292 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.683267    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80210e46-193c-479c-a32b-59e3804f41ea-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.683384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.683305    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-metrics-certs\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.683384 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.683363    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bk7\" (UniqueName: \"kubernetes.io/projected/80210e46-193c-479c-a32b-59e3804f41ea-kube-api-access-49bk7\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.683481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.683387    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.683517 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:30:58.683487    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-serving-cert: secret "maas-api-e2e-ipp-a-19ce3e-serving-cert" not found
Sep 11 21:30:58.683569 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:30:58.683558    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls podName:80210e46-193c-479c-a32b-59e3804f41ea nodeName:}" failed. No retries permitted until 2026-09-11 21:30:59.183540745 +0000 UTC m=+1527.775054048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls") pod "maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" (UID: "80210e46-193c-479c-a32b-59e3804f41ea") : secret "maas-api-e2e-ipp-a-19ce3e-serving-cert" not found
Sep 11 21:30:58.683941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.683923    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80210e46-193c-479c-a32b-59e3804f41ea-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.685763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.685747    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-metrics-certs\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:58.700849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:58.700830    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bk7\" (UniqueName: \"kubernetes.io/projected/80210e46-193c-479c-a32b-59e3804f41ea-kube-api-access-49bk7\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:59.144968 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:59.144935    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:59.188012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:59.187986    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:30:59.188152 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:30:59.188114    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-serving-cert: secret "maas-api-e2e-ipp-a-19ce3e-serving-cert" not found
Sep 11 21:30:59.188201 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:30:59.188177    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls podName:80210e46-193c-479c-a32b-59e3804f41ea nodeName:}" failed. No retries permitted until 2026-09-11 21:31:00.188162405 +0000 UTC m=+1528.779675717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls") pod "maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" (UID: "80210e46-193c-479c-a32b-59e3804f41ea") : secret "maas-api-e2e-ipp-a-19ce3e-serving-cert" not found
Sep 11 21:30:59.250483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:59.250452    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:30:59.456389 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:30:59.456310    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:00.197291 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:00.197260    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:31:00.199468 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:00.199445    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") pod \"maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:31:00.280147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:00.280122    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:31:00.560045 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:00.560017    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"]
Sep 11 21:31:00.561041 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:31:00.561015    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80210e46_193c_479c_a32b_59e3804f41ea.slice/crio-592b2c53ede9e33eca81adf1942756af3330db1ab16b43f0cb422f7b928ef5a8 WatchSource:0}: Error finding container 592b2c53ede9e33eca81adf1942756af3330db1ab16b43f0cb422f7b928ef5a8: Status 404 returned error can't find the container with id 592b2c53ede9e33eca81adf1942756af3330db1ab16b43f0cb422f7b928ef5a8
Sep 11 21:31:00.587760 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:00.587734    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" event={"ID":"80210e46-193c-479c-a32b-59e3804f41ea","Type":"ContainerStarted","Data":"592b2c53ede9e33eca81adf1942756af3330db1ab16b43f0cb422f7b928ef5a8"}
Sep 11 21:31:01.595678 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:01.595615    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" event={"ID":"80210e46-193c-479c-a32b-59e3804f41ea","Type":"ContainerStarted","Data":"82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2"}
Sep 11 21:31:01.596062 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:01.595817    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:31:01.618998 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:01.618951    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" podStartSLOduration=3.204522387 podStartE2EDuration="3.618937334s" totalImagesPullingTime="414.414947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:01.617141192 +0000 UTC m=+1530.208654513" watchObservedRunningTime="2026-09-11 21:31:01.618937334 +0000 UTC m=+1530.210450655"
Sep 11 21:31:07.607512 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:07.607482    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:31:22.528435 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:22.528400    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:23.808149 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:23.808118    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:24.404252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:24.404217    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:25.670899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:25.670875    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:26.350242 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:26.350207    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:27.121177 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:27.121138    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:27.503374 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:27.503285    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:27.776421 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:27.776338    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:30.367460 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:30.367432    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:31.097394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:31.097351    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:31.365045 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:31.364967    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:31.865375 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:31.865344    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:33.297146 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:33.297105    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:34.677272 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:34.677239    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:35.674576 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.674546    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"]
Sep 11 21:31:35.678105 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.678087    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.681418 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.681398    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-e9c558-serving-cert\""
Sep 11 21:31:35.695568 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.695542    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"]
Sep 11 21:31:35.718549 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.718525    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:35.785182 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.785154    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64m72\" (UniqueName: \"kubernetes.io/projected/758f3ac4-860f-4194-8315-8a9baac1001a-kube-api-access-64m72\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.785312 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.785207    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-metrics-certs\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.785312 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.785270    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/758f3ac4-860f-4194-8315-8a9baac1001a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.785441 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.785386    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.820127 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.820097    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:35.886132 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.886108    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64m72\" (UniqueName: \"kubernetes.io/projected/758f3ac4-860f-4194-8315-8a9baac1001a-kube-api-access-64m72\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.886275 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.886160    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-metrics-certs\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.886275 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.886195    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/758f3ac4-860f-4194-8315-8a9baac1001a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.886275 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.886234    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.886453 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:31:35.886330    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-serving-cert: secret "maas-api-e2e-ipp-b-e9c558-serving-cert" not found
Sep 11 21:31:35.886453 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:31:35.886401    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls podName:758f3ac4-860f-4194-8315-8a9baac1001a nodeName:}" failed. No retries permitted until 2026-09-11 21:31:36.386384458 +0000 UTC m=+1564.977897760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls") pod "maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" (UID: "758f3ac4-860f-4194-8315-8a9baac1001a") : secret "maas-api-e2e-ipp-b-e9c558-serving-cert" not found
Sep 11 21:31:35.886843 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.886820    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/758f3ac4-860f-4194-8315-8a9baac1001a-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.888472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.888456    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-metrics-certs\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:35.898996 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:35.898977    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64m72\" (UniqueName: \"kubernetes.io/projected/758f3ac4-860f-4194-8315-8a9baac1001a-kube-api-access-64m72\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:36.010348 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.010288    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.279847 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.279749    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.372462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.372429    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:36.391200 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.391173    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:36.393538 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.393516    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:36.588936 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.588906    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:36.868680 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:36.868628    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"]
Sep 11 21:31:36.869929 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:31:36.869899    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758f3ac4_860f_4194_8315_8a9baac1001a.slice/crio-75cbe9e55d739e3b2344784f5db95867c880a584d4e768ad5e997c992a4a7995 WatchSource:0}: Error finding container 75cbe9e55d739e3b2344784f5db95867c880a584d4e768ad5e997c992a4a7995: Status 404 returned error can't find the container with id 75cbe9e55d739e3b2344784f5db95867c880a584d4e768ad5e997c992a4a7995
Sep 11 21:31:37.812722 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:37.812685    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" event={"ID":"758f3ac4-860f-4194-8315-8a9baac1001a","Type":"ContainerStarted","Data":"904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1"}
Sep 11 21:31:37.812919 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:37.812767    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" event={"ID":"758f3ac4-860f-4194-8315-8a9baac1001a","Type":"ContainerStarted","Data":"75cbe9e55d739e3b2344784f5db95867c880a584d4e768ad5e997c992a4a7995"}
Sep 11 21:31:37.812919 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:37.812792    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:37.833711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:37.833660    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" podStartSLOduration=2.49101527 podStartE2EDuration="2.833632451s" totalImagesPullingTime="342.617181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:37.830753485 +0000 UTC m=+1566.422266807" watchObservedRunningTime="2026-09-11 21:31:37.833632451 +0000 UTC m=+1566.425145772"
Sep 11 21:31:43.825630 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:43.825587    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:31:58.128168 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:58.128133    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:58.927166 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:58.927125    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:31:59.768341 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:31:59.768308    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:00.672558 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:00.672527    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:01.066579 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:01.066539    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:01.496904 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:01.496796    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:15.109705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:15.109668    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:20.397597 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:20.397560    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:32.923703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:32.923584    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:37.413723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:37.413676    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:37.738705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:37.738602    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:37.891759 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:37.891732    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:39.997656 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:39.997605    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:40.819797 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:40.819764    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:40.919667 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:40.919619    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:41.586120 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:41.586081    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:42.451408 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:42.451370    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.246990 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.246951    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.899035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.899006    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"]
Sep 11 21:32:43.902827 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.902806    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:43.905186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.905170    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-8a57ce-serving-cert\""
Sep 11 21:32:43.914621 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.914594    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"]
Sep 11 21:32:43.926402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.926367    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:43.939711 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.939686    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:43.939842 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.939820    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvj2t\" (UniqueName: \"kubernetes.io/projected/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-kube-api-access-dvj2t\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:43.939905 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.939867    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:43.939905 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:43.939896    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.026059 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.026023    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:44.041269 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.041241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.041380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.041287    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvj2t\" (UniqueName: \"kubernetes.io/projected/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-kube-api-access-dvj2t\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.041380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.041353    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.041454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.041383    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.041521 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:32:44.041506    2585 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-serving-cert: secret "maas-api-e2e-ipp-cleanup-8a57ce-serving-cert" not found
Sep 11 21:32:44.041586 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:32:44.041575    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls podName:ffea7431-befe-4e59-88d2-d40fbf7ad5ef nodeName:}" failed. No retries permitted until 2026-09-11 21:32:44.541560039 +0000 UTC m=+1633.133073346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" (UID: "ffea7431-befe-4e59-88d2-d40fbf7ad5ef") : secret "maas-api-e2e-ipp-cleanup-8a57ce-serving-cert" not found
Sep 11 21:32:44.042008 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.041990    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.043824 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.043808    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.051417 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.051399    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvj2t\" (UniqueName: \"kubernetes.io/projected/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-kube-api-access-dvj2t\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.339849 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.339822    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:44.446423 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.446392    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:44.540343 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.540309    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:32:44.545705 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.545678    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.547917 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.547897    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:44.815095 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:44.815066    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:45.105114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:45.105089    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"]
Sep 11 21:32:45.106993 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:32:45.106967    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffea7431_befe_4e59_88d2_d40fbf7ad5ef.slice/crio-f6f2d18a73d5b0850e667fd78be09bfd9c410abcdbaecb4ce3fd2cbbe5b01cd7 WatchSource:0}: Error finding container f6f2d18a73d5b0850e667fd78be09bfd9c410abcdbaecb4ce3fd2cbbe5b01cd7: Status 404 returned error can't find the container with id f6f2d18a73d5b0850e667fd78be09bfd9c410abcdbaecb4ce3fd2cbbe5b01cd7
Sep 11 21:32:45.108306 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:45.108290    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:32:45.207863 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:45.207834    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" event={"ID":"ffea7431-befe-4e59-88d2-d40fbf7ad5ef","Type":"ContainerStarted","Data":"f6f2d18a73d5b0850e667fd78be09bfd9c410abcdbaecb4ce3fd2cbbe5b01cd7"}
Sep 11 21:32:46.215012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:46.214973    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" event={"ID":"ffea7431-befe-4e59-88d2-d40fbf7ad5ef","Type":"ContainerStarted","Data":"d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8"}
Sep 11 21:32:46.215396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:46.215104    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:32:46.232941 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:46.232899    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" podStartSLOduration=2.83859936 podStartE2EDuration="3.232885023s" totalImagesPullingTime="394.285663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:46.231238049 +0000 UTC m=+1634.822751373" watchObservedRunningTime="2026-09-11 21:32:46.232885023 +0000 UTC m=+1634.824398344"
Sep 11 21:32:52.226695 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:32:52.226655    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:33:06.010655 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:06.010589    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:06.688715 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:06.688628    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:07.490226 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:07.490166    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:08.416720 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:08.416689    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:09.144476 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:09.144440    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:10.001171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:10.001137    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:10.928266 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:10.928221    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:12.475009 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:12.474965    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:13.175522 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:13.175477    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:13.889908 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:13.889872    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:14.707073 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:14.707041    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:15.416719 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:15.416690    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:16.117888 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:16.117857    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:22.872213 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:22.872179    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"]
Sep 11 21:33:22.872628 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:22.872428    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" podUID="ffea7431-befe-4e59-88d2-d40fbf7ad5ef" containerName="maas-api" containerID="cri-o://d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8" gracePeriod=30
Sep 11 21:33:22.904857 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:22.904831    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:22.982160 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:22.982121    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:23.060382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.060346    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:23.116147 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.116125    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:33:23.162209 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.162133    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:23.243779 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.243749    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:23.275912 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.275878    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvj2t\" (UniqueName: \"kubernetes.io/projected/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-kube-api-access-dvj2t\") pod \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") "
Sep 11 21:33:23.276150 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.275996    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-metrics-certs\") pod \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") "
Sep 11 21:33:23.276150 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.276036    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls\") pod \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") "
Sep 11 21:33:23.276150 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.276090    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-openshift-service-ca\") pod \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\" (UID: \"ffea7431-befe-4e59-88d2-d40fbf7ad5ef\") "
Sep 11 21:33:23.279315 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.276760    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ffea7431-befe-4e59-88d2-d40fbf7ad5ef" (UID: "ffea7431-befe-4e59-88d2-d40fbf7ad5ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:23.279913 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.279863    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ffea7431-befe-4e59-88d2-d40fbf7ad5ef" (UID: "ffea7431-befe-4e59-88d2-d40fbf7ad5ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:33:23.280764 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.280712    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ffea7431-befe-4e59-88d2-d40fbf7ad5ef" (UID: "ffea7431-befe-4e59-88d2-d40fbf7ad5ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:33:23.281289 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.281262    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-kube-api-access-dvj2t" (OuterVolumeSpecName: "kube-api-access-dvj2t") pod "ffea7431-befe-4e59-88d2-d40fbf7ad5ef" (UID: "ffea7431-befe-4e59-88d2-d40fbf7ad5ef"). InnerVolumeSpecName "kube-api-access-dvj2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:23.377443 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.377418    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:23.377443 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.377439    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvj2t\" (UniqueName: \"kubernetes.io/projected/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-kube-api-access-dvj2t\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:23.377607 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.377450    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:23.377607 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.377459    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ffea7431-befe-4e59-88d2-d40fbf7ad5ef-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:23.434004 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.433938    2585 generic.go:356] "Generic (PLEG): container finished" podID="ffea7431-befe-4e59-88d2-d40fbf7ad5ef" containerID="d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8" exitCode=0
Sep 11 21:33:23.434004 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.433983    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"
Sep 11 21:33:23.434156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.434023    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" event={"ID":"ffea7431-befe-4e59-88d2-d40fbf7ad5ef","Type":"ContainerDied","Data":"d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8"}
Sep 11 21:33:23.434156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.434071    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d" event={"ID":"ffea7431-befe-4e59-88d2-d40fbf7ad5ef","Type":"ContainerDied","Data":"f6f2d18a73d5b0850e667fd78be09bfd9c410abcdbaecb4ce3fd2cbbe5b01cd7"}
Sep 11 21:33:23.434156 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.434095    2585 scope.go:117] "RemoveContainer" containerID="d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8"
Sep 11 21:33:23.443459 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.443444    2585 scope.go:117] "RemoveContainer" containerID="d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8"
Sep 11 21:33:23.443716 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:33:23.443693    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8\": container with ID starting with d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8 not found: ID does not exist" containerID="d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8"
Sep 11 21:33:23.443816 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.443720    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8"} err="failed to get container status \"d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8\": rpc error: code = NotFound desc = could not find container \"d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8\": container with ID starting with d48ce077d8291348bcdfdbffca9e86c57486c7423b6324453d6432cdd42684c8 not found: ID does not exist"
Sep 11 21:33:23.456493 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.456469    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"]
Sep 11 21:33:23.461618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.461598    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-8a57ce-5fb4694887-jzq4d"]
Sep 11 21:33:23.508942 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.508922    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:23.610367 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.610339    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:23.887125 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:23.887098    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffea7431-befe-4e59-88d2-d40fbf7ad5ef" path="/var/lib/kubelet/pods/ffea7431-befe-4e59-88d2-d40fbf7ad5ef/volumes"
Sep 11 21:33:24.316976 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:24.316941    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:25.243184 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:25.243154    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:26.009763 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:26.009730    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:26.817454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:26.817420    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:29.388600 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:29.388563    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:29.456252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:29.456223    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:29.652647 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:29.652560    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:32.143472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:32.143432    2585 scope.go:117] "RemoveContainer" containerID="a86e12d4eb1687b87f2f00eb34daddb5ddfdb22cd0d1d78752f54d27464b5151"
Sep 11 21:33:33.410341 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:33.410303    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:34.212309 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:34.212276    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:35.094373 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:35.094344    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:35.798603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:35.798568    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:36.571481 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:36.571450    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:37.251321 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:37.251270    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:48.958360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:48.958316    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"]
Sep 11 21:33:48.958890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:48.958602    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" podUID="80210e46-193c-479c-a32b-59e3804f41ea" containerName="maas-api" containerID="cri-o://82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2" gracePeriod=30
Sep 11 21:33:48.992662 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:48.992614    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.065465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.065419    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.132616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.132581    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.207692 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.207671    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:33:49.208981 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.208903    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.275813 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.275781    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.278860 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.278840    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") pod \"80210e46-193c-479c-a32b-59e3804f41ea\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") "
Sep 11 21:33:49.278943 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.278887    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49bk7\" (UniqueName: \"kubernetes.io/projected/80210e46-193c-479c-a32b-59e3804f41ea-kube-api-access-49bk7\") pod \"80210e46-193c-479c-a32b-59e3804f41ea\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") "
Sep 11 21:33:49.278943 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.278928    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80210e46-193c-479c-a32b-59e3804f41ea-openshift-service-ca\") pod \"80210e46-193c-479c-a32b-59e3804f41ea\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") "
Sep 11 21:33:49.279031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.278954    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-metrics-certs\") pod \"80210e46-193c-479c-a32b-59e3804f41ea\" (UID: \"80210e46-193c-479c-a32b-59e3804f41ea\") "
Sep 11 21:33:49.279290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.279268    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80210e46-193c-479c-a32b-59e3804f41ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80210e46-193c-479c-a32b-59e3804f41ea" (UID: "80210e46-193c-479c-a32b-59e3804f41ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:49.281165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.281134    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80210e46-193c-479c-a32b-59e3804f41ea-kube-api-access-49bk7" (OuterVolumeSpecName: "kube-api-access-49bk7") pod "80210e46-193c-479c-a32b-59e3804f41ea" (UID: "80210e46-193c-479c-a32b-59e3804f41ea"). InnerVolumeSpecName "kube-api-access-49bk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:49.281165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.281149    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "80210e46-193c-479c-a32b-59e3804f41ea" (UID: "80210e46-193c-479c-a32b-59e3804f41ea"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:33:49.281165 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.281161    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80210e46-193c-479c-a32b-59e3804f41ea" (UID: "80210e46-193c-479c-a32b-59e3804f41ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:33:49.380352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.380320    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49bk7\" (UniqueName: \"kubernetes.io/projected/80210e46-193c-479c-a32b-59e3804f41ea-kube-api-access-49bk7\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.380352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.380351    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80210e46-193c-479c-a32b-59e3804f41ea-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.380352 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.380361    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.380577 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.380369    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80210e46-193c-479c-a32b-59e3804f41ea-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:33:49.583379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.583338    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.589452 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.589428    2585 generic.go:356] "Generic (PLEG): container finished" podID="80210e46-193c-479c-a32b-59e3804f41ea" containerID="82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2" exitCode=0
Sep 11 21:33:49.589586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.589457    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" event={"ID":"80210e46-193c-479c-a32b-59e3804f41ea","Type":"ContainerDied","Data":"82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2"}
Sep 11 21:33:49.589586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.589476    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"
Sep 11 21:33:49.589586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.589508    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg" event={"ID":"80210e46-193c-479c-a32b-59e3804f41ea","Type":"ContainerDied","Data":"592b2c53ede9e33eca81adf1942756af3330db1ab16b43f0cb422f7b928ef5a8"}
Sep 11 21:33:49.589586 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.589539    2585 scope.go:117] "RemoveContainer" containerID="82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2"
Sep 11 21:33:49.599460 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.599446    2585 scope.go:117] "RemoveContainer" containerID="82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2"
Sep 11 21:33:49.599734 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:33:49.599716    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2\": container with ID starting with 82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2 not found: ID does not exist" containerID="82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2"
Sep 11 21:33:49.599806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.599739    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2"} err="failed to get container status \"82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2\": rpc error: code = NotFound desc = could not find container \"82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2\": container with ID starting with 82a725dca4d1d2c8a7c80220280359b6df74cd85a89af49d3da83b6e73332ab2 not found: ID does not exist"
Sep 11 21:33:49.613205 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.613166    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"]
Sep 11 21:33:49.615680 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.615663    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-19ce3e-765fc44799-8fwcg"]
Sep 11 21:33:49.688278 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.688249    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:49.886681 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:49.886605    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80210e46-193c-479c-a32b-59e3804f41ea" path="/var/lib/kubelet/pods/80210e46-193c-479c-a32b-59e3804f41ea/volumes"
Sep 11 21:33:50.347946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:50.347915    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:51.170952 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:51.170920    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:51.873874 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:51.873839    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:33:54.655970 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:33:54.655874    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:30.705755 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:30.705703    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:31.456095 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:31.456055    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:32.075438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:32.075402    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:37.712110 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:37.712072    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:37.812962 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:37.812912    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.005046 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:38.004962    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:38.592784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:38.592750    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:39.481199 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:39.481163    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:40.204949 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:40.204916    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:40.911591 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:40.911561    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:41.696703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:41.696665    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:48.887836 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:48.887788    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"]
Sep 11 21:34:48.888290 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:48.888021    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" podUID="758f3ac4-860f-4194-8315-8a9baac1001a" containerName="maas-api" containerID="cri-o://904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1" gracePeriod=30
Sep 11 21:34:48.919699 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:48.919669    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:48.993933 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:48.993845    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:49.073742 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.073702    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:49.145721 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.145624    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:49.150915 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.150896    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:34:49.213472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.213442    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:49.265825 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.265802    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/758f3ac4-860f-4194-8315-8a9baac1001a-openshift-service-ca\") pod \"758f3ac4-860f-4194-8315-8a9baac1001a\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") "
Sep 11 21:34:49.265980 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.265831    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls\") pod \"758f3ac4-860f-4194-8315-8a9baac1001a\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") "
Sep 11 21:34:49.265980 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.265879    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-metrics-certs\") pod \"758f3ac4-860f-4194-8315-8a9baac1001a\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") "
Sep 11 21:34:49.265980 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.265937    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64m72\" (UniqueName: \"kubernetes.io/projected/758f3ac4-860f-4194-8315-8a9baac1001a-kube-api-access-64m72\") pod \"758f3ac4-860f-4194-8315-8a9baac1001a\" (UID: \"758f3ac4-860f-4194-8315-8a9baac1001a\") "
Sep 11 21:34:49.266224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.266200    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/758f3ac4-860f-4194-8315-8a9baac1001a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "758f3ac4-860f-4194-8315-8a9baac1001a" (UID: "758f3ac4-860f-4194-8315-8a9baac1001a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:49.268050 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.268020    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/758f3ac4-860f-4194-8315-8a9baac1001a-kube-api-access-64m72" (OuterVolumeSpecName: "kube-api-access-64m72") pod "758f3ac4-860f-4194-8315-8a9baac1001a" (UID: "758f3ac4-860f-4194-8315-8a9baac1001a"). InnerVolumeSpecName "kube-api-access-64m72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:49.268151 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.268067    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "758f3ac4-860f-4194-8315-8a9baac1001a" (UID: "758f3ac4-860f-4194-8315-8a9baac1001a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:49.268151 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.268140    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "758f3ac4-860f-4194-8315-8a9baac1001a" (UID: "758f3ac4-860f-4194-8315-8a9baac1001a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:49.363671 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.363607    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:49.367618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.367593    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/758f3ac4-860f-4194-8315-8a9baac1001a-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.367618 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.367619    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.367776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.367629    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/758f3ac4-860f-4194-8315-8a9baac1001a-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.367776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.367660    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64m72\" (UniqueName: \"kubernetes.io/projected/758f3ac4-860f-4194-8315-8a9baac1001a-kube-api-access-64m72\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:34:49.512377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.512278    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:49.955518 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.955483    2585 generic.go:356] "Generic (PLEG): container finished" podID="758f3ac4-860f-4194-8315-8a9baac1001a" containerID="904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1" exitCode=0
Sep 11 21:34:49.955963 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.955529    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"
Sep 11 21:34:49.955963 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.955565    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" event={"ID":"758f3ac4-860f-4194-8315-8a9baac1001a","Type":"ContainerDied","Data":"904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1"}
Sep 11 21:34:49.955963 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.955613    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj" event={"ID":"758f3ac4-860f-4194-8315-8a9baac1001a","Type":"ContainerDied","Data":"75cbe9e55d739e3b2344784f5db95867c880a584d4e768ad5e997c992a4a7995"}
Sep 11 21:34:49.955963 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.955670    2585 scope.go:117] "RemoveContainer" containerID="904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1"
Sep 11 21:34:49.965584 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.965561    2585 scope.go:117] "RemoveContainer" containerID="904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1"
Sep 11 21:34:49.965846 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:34:49.965827    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1\": container with ID starting with 904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1 not found: ID does not exist" containerID="904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1"
Sep 11 21:34:49.965917 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.965854    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1"} err="failed to get container status \"904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1\": rpc error: code = NotFound desc = could not find container \"904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1\": container with ID starting with 904afb92c835e308d6fb7afa50474526852e59246a71b20968d80d80d0aa64c1 not found: ID does not exist"
Sep 11 21:34:49.973936 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.973914    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"]
Sep 11 21:34:49.978221 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:49.978196    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e9c558-76fb48867c-xr2tj"]
Sep 11 21:34:50.198542 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:50.198475    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:50.940472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:50.940444    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:51.691376 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:51.691345    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:51.886212 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:51.886178    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="758f3ac4-860f-4194-8315-8a9baac1001a" path="/var/lib/kubelet/pods/758f3ac4-860f-4194-8315-8a9baac1001a/volumes"
Sep 11 21:34:55.402360 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:55.402322    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:55.471342 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:55.471302    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:55.661544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:55.661465    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:56.116206 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:56.116171    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:56.986528 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:56.986494    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:57.876470 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:57.876422    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:34:58.578947 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:34:58.578911    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.569567 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.569529    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"]
Sep 11 21:35:06.570003 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.569743    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" podUID="31b825f1-b5a9-4b3f-bfca-59c76164c40e" containerName="maas-api" containerID="cri-o://3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9" gracePeriod=30
Sep 11 21:35:06.603031 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.602994    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.672396 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.672353    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.733899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.733861    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.813317 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.813287    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.822837 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.822774    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:35:06.872473 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.872440    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:06.914026 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.914001    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cs9x\" (UniqueName: \"kubernetes.io/projected/31b825f1-b5a9-4b3f-bfca-59c76164c40e-kube-api-access-2cs9x\") pod \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") "
Sep 11 21:35:06.914148 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.914046    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-metrics-certs\") pod \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") "
Sep 11 21:35:06.914148 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.914063    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls\") pod \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") "
Sep 11 21:35:06.914582 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.914119    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b825f1-b5a9-4b3f-bfca-59c76164c40e-openshift-service-ca\") pod \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\" (UID: \"31b825f1-b5a9-4b3f-bfca-59c76164c40e\") "
Sep 11 21:35:06.914717 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.914615    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b825f1-b5a9-4b3f-bfca-59c76164c40e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31b825f1-b5a9-4b3f-bfca-59c76164c40e" (UID: "31b825f1-b5a9-4b3f-bfca-59c76164c40e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:06.917259 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.915695    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31b825f1-b5a9-4b3f-bfca-59c76164c40e-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:06.919244 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.918227    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31b825f1-b5a9-4b3f-bfca-59c76164c40e" (UID: "31b825f1-b5a9-4b3f-bfca-59c76164c40e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:06.927252 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.927020    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b825f1-b5a9-4b3f-bfca-59c76164c40e-kube-api-access-2cs9x" (OuterVolumeSpecName: "kube-api-access-2cs9x") pod "31b825f1-b5a9-4b3f-bfca-59c76164c40e" (UID: "31b825f1-b5a9-4b3f-bfca-59c76164c40e"). InnerVolumeSpecName "kube-api-access-2cs9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:06.927914 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:06.927875    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31b825f1-b5a9-4b3f-bfca-59c76164c40e" (UID: "31b825f1-b5a9-4b3f-bfca-59c76164c40e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:07.016504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.016466    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cs9x\" (UniqueName: \"kubernetes.io/projected/31b825f1-b5a9-4b3f-bfca-59c76164c40e-kube-api-access-2cs9x\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:07.016504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.016497    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:07.016504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.016510    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31b825f1-b5a9-4b3f-bfca-59c76164c40e-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:07.058377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.058345    2585 generic.go:356] "Generic (PLEG): container finished" podID="31b825f1-b5a9-4b3f-bfca-59c76164c40e" containerID="3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9" exitCode=0
Sep 11 21:35:07.058502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.058403    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"
Sep 11 21:35:07.058502 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.058436    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" event={"ID":"31b825f1-b5a9-4b3f-bfca-59c76164c40e","Type":"ContainerDied","Data":"3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9"}
Sep 11 21:35:07.058574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.058519    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr" event={"ID":"31b825f1-b5a9-4b3f-bfca-59c76164c40e","Type":"ContainerDied","Data":"85434fd778a9bd61c16ad31aef792033be58b44b385fe2cfad846bdda8fb92c6"}
Sep 11 21:35:07.058574 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.058541    2585 scope.go:117] "RemoveContainer" containerID="3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9"
Sep 11 21:35:07.068099 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.068084    2585 scope.go:117] "RemoveContainer" containerID="3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9"
Sep 11 21:35:07.068345 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:35:07.068328    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9\": container with ID starting with 3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9 not found: ID does not exist" containerID="3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9"
Sep 11 21:35:07.068394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.068351    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9"} err="failed to get container status \"3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9\": rpc error: code = NotFound desc = could not find container \"3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9\": container with ID starting with 3d06428c3ddb0e96c6c971ca12d09c1141003f3edac79a93b45a3742833265b9 not found: ID does not exist"
Sep 11 21:35:07.079784 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.079731    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"]
Sep 11 21:35:07.085216 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.085197    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2bd772-68dbbf5dd8-vdzbr"]
Sep 11 21:35:07.187074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.187039    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:07.290045 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.290012    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:07.887767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:07.887731    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b825f1-b5a9-4b3f-bfca-59c76164c40e" path="/var/lib/kubelet/pods/31b825f1-b5a9-4b3f-bfca-59c76164c40e/volumes"
Sep 11 21:35:08.145243 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:08.145166    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:13.297157 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:13.297119    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:13.398890 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:13.398854    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:13.564572 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:13.564486    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:14.801302 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:14.801262    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:15.495419 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:15.495384    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:24.542824 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.542742    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"]
Sep 11 21:35:24.543284 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.543025    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" podUID="94fd769d-243a-4a1e-be74-b794f9f49a36" containerName="maas-api" containerID="cri-o://a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f" gracePeriod=30
Sep 11 21:35:24.578736 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.578703    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:24.676776 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.676746    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:24.776568 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.776539    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:24.795224 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.795173    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:35:24.900974 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.900940    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:24.958801 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.958774    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls\") pod \"94fd769d-243a-4a1e-be74-b794f9f49a36\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") "
Sep 11 21:35:24.958946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.958846    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94fd769d-243a-4a1e-be74-b794f9f49a36-openshift-service-ca\") pod \"94fd769d-243a-4a1e-be74-b794f9f49a36\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") "
Sep 11 21:35:24.958946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.958871    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpfw6\" (UniqueName: \"kubernetes.io/projected/94fd769d-243a-4a1e-be74-b794f9f49a36-kube-api-access-jpfw6\") pod \"94fd769d-243a-4a1e-be74-b794f9f49a36\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") "
Sep 11 21:35:24.958946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.958896    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-metrics-certs\") pod \"94fd769d-243a-4a1e-be74-b794f9f49a36\" (UID: \"94fd769d-243a-4a1e-be74-b794f9f49a36\") "
Sep 11 21:35:24.959221 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.959200    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94fd769d-243a-4a1e-be74-b794f9f49a36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "94fd769d-243a-4a1e-be74-b794f9f49a36" (UID: "94fd769d-243a-4a1e-be74-b794f9f49a36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:35:24.960991 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.960964    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "94fd769d-243a-4a1e-be74-b794f9f49a36" (UID: "94fd769d-243a-4a1e-be74-b794f9f49a36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:24.960991 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.960978    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "94fd769d-243a-4a1e-be74-b794f9f49a36" (UID: "94fd769d-243a-4a1e-be74-b794f9f49a36"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:24.961130 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:24.961047    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94fd769d-243a-4a1e-be74-b794f9f49a36-kube-api-access-jpfw6" (OuterVolumeSpecName: "kube-api-access-jpfw6") pod "94fd769d-243a-4a1e-be74-b794f9f49a36" (UID: "94fd769d-243a-4a1e-be74-b794f9f49a36"). InnerVolumeSpecName "kube-api-access-jpfw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:25.060116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.060054    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/94fd769d-243a-4a1e-be74-b794f9f49a36-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:25.060116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.060080    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpfw6\" (UniqueName: \"kubernetes.io/projected/94fd769d-243a-4a1e-be74-b794f9f49a36-kube-api-access-jpfw6\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:25.060116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.060091    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:25.060116 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.060099    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/94fd769d-243a-4a1e-be74-b794f9f49a36-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:25.163950 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.163923    2585 generic.go:356] "Generic (PLEG): container finished" podID="94fd769d-243a-4a1e-be74-b794f9f49a36" containerID="a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f" exitCode=0
Sep 11 21:35:25.164083 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.163966    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"
Sep 11 21:35:25.164083 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.164020    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" event={"ID":"94fd769d-243a-4a1e-be74-b794f9f49a36","Type":"ContainerDied","Data":"a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f"}
Sep 11 21:35:25.164083 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.164073    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6" event={"ID":"94fd769d-243a-4a1e-be74-b794f9f49a36","Type":"ContainerDied","Data":"a9567c5344be2734dbb28a3d5283a4bb9cb271460b56a654ae57e33f1db7689d"}
Sep 11 21:35:25.164188 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.164101    2585 scope.go:117] "RemoveContainer" containerID="a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f"
Sep 11 21:35:25.173372 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.173353    2585 scope.go:117] "RemoveContainer" containerID="a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f"
Sep 11 21:35:25.173628 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:35:25.173611    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f\": container with ID starting with a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f not found: ID does not exist" containerID="a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f"
Sep 11 21:35:25.173690 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.173657    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f"} err="failed to get container status \"a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f\": rpc error: code = NotFound desc = could not find container \"a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f\": container with ID starting with a2e2704ed4b269dbfedff19c9e842478d40ce69c03d3cafad5a3383368a70f3f not found: ID does not exist"
Sep 11 21:35:25.190684 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.190653    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"]
Sep 11 21:35:25.198212 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.198188    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-713791-5dc4564d7-kjtn6"]
Sep 11 21:35:25.245616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.245588    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:25.347349 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.347288    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:25.886694 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:25.886666    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94fd769d-243a-4a1e-be74-b794f9f49a36" path="/var/lib/kubelet/pods/94fd769d-243a-4a1e-be74-b794f9f49a36/volumes"
Sep 11 21:35:31.712660 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:31.712591    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:31.789491 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:31.789457    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:32.005955 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:32.005878    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:35:32.039426 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:32.039401    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:35:32.044144 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:32.044123    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:35:32.045806 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:32.045789    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:35:32.050843 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:32.050825    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:35:34.617504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:34.617477    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-mbz6d"]
Sep 11 21:35:34.617927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:34.617690    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8499ccbc4-mbz6d" podUID="75bf5395-6511-4a47-8cde-0f35f98d42db" containerName="manager" containerID="cri-o://5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34" gracePeriod=30
Sep 11 21:35:34.854329 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:34.854302    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:35:35.039102 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.039079    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-webhook-cert\") pod \"75bf5395-6511-4a47-8cde-0f35f98d42db\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") "
Sep 11 21:35:35.039233 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.039148    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-metrics-certs\") pod \"75bf5395-6511-4a47-8cde-0f35f98d42db\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") "
Sep 11 21:35:35.039344 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.039323    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c27rx\" (UniqueName: \"kubernetes.io/projected/75bf5395-6511-4a47-8cde-0f35f98d42db-kube-api-access-c27rx\") pod \"75bf5395-6511-4a47-8cde-0f35f98d42db\" (UID: \"75bf5395-6511-4a47-8cde-0f35f98d42db\") "
Sep 11 21:35:35.041074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.041048    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "75bf5395-6511-4a47-8cde-0f35f98d42db" (UID: "75bf5395-6511-4a47-8cde-0f35f98d42db"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:35.041207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.041078    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "75bf5395-6511-4a47-8cde-0f35f98d42db" (UID: "75bf5395-6511-4a47-8cde-0f35f98d42db"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:35:35.041207 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.041135    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75bf5395-6511-4a47-8cde-0f35f98d42db-kube-api-access-c27rx" (OuterVolumeSpecName: "kube-api-access-c27rx") pod "75bf5395-6511-4a47-8cde-0f35f98d42db" (UID: "75bf5395-6511-4a47-8cde-0f35f98d42db"). InnerVolumeSpecName "kube-api-access-c27rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:35.140196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.140170    2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-webhook-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:35.140196 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.140191    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/75bf5395-6511-4a47-8cde-0f35f98d42db-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:35.140333 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.140201    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c27rx\" (UniqueName: \"kubernetes.io/projected/75bf5395-6511-4a47-8cde-0f35f98d42db-kube-api-access-c27rx\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:35:35.223379 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.223353    2585 generic.go:356] "Generic (PLEG): container finished" podID="75bf5395-6511-4a47-8cde-0f35f98d42db" containerID="5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34" exitCode=0
Sep 11 21:35:35.223479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.223400    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-mbz6d"
Sep 11 21:35:35.223479 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.223441    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-mbz6d" event={"ID":"75bf5395-6511-4a47-8cde-0f35f98d42db","Type":"ContainerDied","Data":"5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34"}
Sep 11 21:35:35.223556 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.223497    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-mbz6d" event={"ID":"75bf5395-6511-4a47-8cde-0f35f98d42db","Type":"ContainerDied","Data":"dfeadf340ba8d2bfbc0fd43bf6f5f636b22a385f9fd5b6beb23252e0e4f6281e"}
Sep 11 21:35:35.223556 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.223523    2585 scope.go:117] "RemoveContainer" containerID="5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34"
Sep 11 21:35:35.233146 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.233126    2585 scope.go:117] "RemoveContainer" containerID="5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34"
Sep 11 21:35:35.233400 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:35:35.233382    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34\": container with ID starting with 5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34 not found: ID does not exist" containerID="5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34"
Sep 11 21:35:35.233441 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.233409    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34"} err="failed to get container status \"5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34\": rpc error: code = NotFound desc = could not find container \"5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34\": container with ID starting with 5e979e8af71665d12a0b0dfdd455aabd597a9db69e18a4f24814e6fca843ab34 not found: ID does not exist"
Sep 11 21:35:35.246186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.246164    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-mbz6d"]
Sep 11 21:35:35.251313 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.251292    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-mbz6d"]
Sep 11 21:35:35.886921 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:35:35.886890    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75bf5395-6511-4a47-8cde-0f35f98d42db" path="/var/lib/kubelet/pods/75bf5395-6511-4a47-8cde-0f35f98d42db/volumes"
Sep 11 21:36:07.546795 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:07.546746    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:07.649718 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:07.649680    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:15.684587 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:15.684539    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:36.100803 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.100763    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8499ccbc4-kt9g2"]
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101157    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94fd769d-243a-4a1e-be74-b794f9f49a36" containerName="maas-api"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101169    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="94fd769d-243a-4a1e-be74-b794f9f49a36" containerName="maas-api"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101185    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffea7431-befe-4e59-88d2-d40fbf7ad5ef" containerName="maas-api"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101191    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffea7431-befe-4e59-88d2-d40fbf7ad5ef" containerName="maas-api"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101204    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75bf5395-6511-4a47-8cde-0f35f98d42db" containerName="manager"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101209    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="75bf5395-6511-4a47-8cde-0f35f98d42db" containerName="manager"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101216    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b825f1-b5a9-4b3f-bfca-59c76164c40e" containerName="maas-api"
Sep 11 21:36:36.101225 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101221    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b825f1-b5a9-4b3f-bfca-59c76164c40e" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101233    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80210e46-193c-479c-a32b-59e3804f41ea" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101239    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="80210e46-193c-479c-a32b-59e3804f41ea" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101245    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="758f3ac4-860f-4194-8315-8a9baac1001a" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101251    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="758f3ac4-860f-4194-8315-8a9baac1001a" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101316    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b825f1-b5a9-4b3f-bfca-59c76164c40e" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101323    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="94fd769d-243a-4a1e-be74-b794f9f49a36" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101332    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffea7431-befe-4e59-88d2-d40fbf7ad5ef" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101340    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="80210e46-193c-479c-a32b-59e3804f41ea" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101345    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="758f3ac4-860f-4194-8315-8a9baac1001a" containerName="maas-api"
Sep 11 21:36:36.101483 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.101351    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="75bf5395-6511-4a47-8cde-0f35f98d42db" containerName="manager"
Sep 11 21:36:36.104462 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.104443    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.107172 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.107147    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:36:36.107843 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.107819    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:36:36.108036 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.108021    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:36:36.108114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.108092    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ncdvn\""
Sep 11 21:36:36.120978 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.120952    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-kt9g2"]
Sep 11 21:36:36.138954 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.138926    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-metrics-certs\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.139086 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.138970    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2jkf\" (UniqueName: \"kubernetes.io/projected/066ab72b-f62d-4926-a5f9-f6491b698bcd-kube-api-access-h2jkf\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.139086 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.138999    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-webhook-cert\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.239741 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.239715    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2jkf\" (UniqueName: \"kubernetes.io/projected/066ab72b-f62d-4926-a5f9-f6491b698bcd-kube-api-access-h2jkf\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.239847 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.239754    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-webhook-cert\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.239847 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.239806    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-metrics-certs\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.242332 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.242303    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-webhook-cert\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.242442 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.242418    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-metrics-certs\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.250123 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.250097    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2jkf\" (UniqueName: \"kubernetes.io/projected/066ab72b-f62d-4926-a5f9-f6491b698bcd-kube-api-access-h2jkf\") pod \"maas-controller-8499ccbc4-kt9g2\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") " pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.415994 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.415935    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:36.699249 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:36.699225    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-kt9g2"]
Sep 11 21:36:36.701678 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:36:36.701602    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066ab72b_f62d_4926_a5f9_f6491b698bcd.slice/crio-76a1dee91f16a23c020668900f5fa20a9f62a839ac7ef76cfbb82c8abc54dbc3 WatchSource:0}: Error finding container 76a1dee91f16a23c020668900f5fa20a9f62a839ac7ef76cfbb82c8abc54dbc3: Status 404 returned error can't find the container with id 76a1dee91f16a23c020668900f5fa20a9f62a839ac7ef76cfbb82c8abc54dbc3
Sep 11 21:36:37.592531 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:37.592492    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-kt9g2" event={"ID":"066ab72b-f62d-4926-a5f9-f6491b698bcd","Type":"ContainerStarted","Data":"76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37"}
Sep 11 21:36:37.592934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:37.592555    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-kt9g2" event={"ID":"066ab72b-f62d-4926-a5f9-f6491b698bcd","Type":"ContainerStarted","Data":"76a1dee91f16a23c020668900f5fa20a9f62a839ac7ef76cfbb82c8abc54dbc3"}
Sep 11 21:36:37.592934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:37.592675    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:37.610957 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:37.610916    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8499ccbc4-kt9g2" podStartSLOduration=1.198509743 podStartE2EDuration="1.610903118s" totalImagesPullingTime="412.393375ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:37.608799903 +0000 UTC m=+1866.200313237" watchObservedRunningTime="2026-09-11 21:36:37.610903118 +0000 UTC m=+1866.202416439"
Sep 11 21:36:48.603765 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:48.603727    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:55.863402 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:55.863323    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:55.928284 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:55.928253    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-kt9g2"]
Sep 11 21:36:55.928465 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:55.928426    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8499ccbc4-kt9g2" podUID="066ab72b-f62d-4926-a5f9-f6491b698bcd" containerName="manager" containerID="cri-o://76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37" gracePeriod=30
Sep 11 21:36:56.170464 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.170440    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:56.299398 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.299370    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-webhook-cert\") pod \"066ab72b-f62d-4926-a5f9-f6491b698bcd\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") "
Sep 11 21:36:56.299567 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.299443    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-metrics-certs\") pod \"066ab72b-f62d-4926-a5f9-f6491b698bcd\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") "
Sep 11 21:36:56.299567 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.299480    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2jkf\" (UniqueName: \"kubernetes.io/projected/066ab72b-f62d-4926-a5f9-f6491b698bcd-kube-api-access-h2jkf\") pod \"066ab72b-f62d-4926-a5f9-f6491b698bcd\" (UID: \"066ab72b-f62d-4926-a5f9-f6491b698bcd\") "
Sep 11 21:36:56.301459 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.301431    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "066ab72b-f62d-4926-a5f9-f6491b698bcd" (UID: "066ab72b-f62d-4926-a5f9-f6491b698bcd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:56.301566 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.301479    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "066ab72b-f62d-4926-a5f9-f6491b698bcd" (UID: "066ab72b-f62d-4926-a5f9-f6491b698bcd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:56.301566 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.301505    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/066ab72b-f62d-4926-a5f9-f6491b698bcd-kube-api-access-h2jkf" (OuterVolumeSpecName: "kube-api-access-h2jkf") pod "066ab72b-f62d-4926-a5f9-f6491b698bcd" (UID: "066ab72b-f62d-4926-a5f9-f6491b698bcd"). InnerVolumeSpecName "kube-api-access-h2jkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:56.400899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.400844    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:36:56.400899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.400864    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2jkf\" (UniqueName: \"kubernetes.io/projected/066ab72b-f62d-4926-a5f9-f6491b698bcd-kube-api-access-h2jkf\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:36:56.400899 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.400873    2585 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/066ab72b-f62d-4926-a5f9-f6491b698bcd-webhook-cert\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:36:56.707562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.707500    2585 generic.go:356] "Generic (PLEG): container finished" podID="066ab72b-f62d-4926-a5f9-f6491b698bcd" containerID="76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37" exitCode=0
Sep 11 21:36:56.707562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.707536    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-kt9g2" event={"ID":"066ab72b-f62d-4926-a5f9-f6491b698bcd","Type":"ContainerDied","Data":"76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37"}
Sep 11 21:36:56.707562 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.707547    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-kt9g2"
Sep 11 21:36:56.707783 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.707573    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-kt9g2" event={"ID":"066ab72b-f62d-4926-a5f9-f6491b698bcd","Type":"ContainerDied","Data":"76a1dee91f16a23c020668900f5fa20a9f62a839ac7ef76cfbb82c8abc54dbc3"}
Sep 11 21:36:56.707783 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.707595    2585 scope.go:117] "RemoveContainer" containerID="76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37"
Sep 11 21:36:56.717553 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.717537    2585 scope.go:117] "RemoveContainer" containerID="76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37"
Sep 11 21:36:56.717894 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:36:56.717863    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37\": container with ID starting with 76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37 not found: ID does not exist" containerID="76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37"
Sep 11 21:36:56.717971 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.717908    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37"} err="failed to get container status \"76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37\": rpc error: code = NotFound desc = could not find container \"76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37\": container with ID starting with 76be220eb6b0b7ac7daa3d5a2d99fcb42a0b693fe311785fc2f4c974f5676b37 not found: ID does not exist"
Sep 11 21:36:56.743173 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.743147    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-kt9g2"]
Sep 11 21:36:56.751544 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:56.751523    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-kt9g2"]
Sep 11 21:36:57.488033 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.487998    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:36:57.573718 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.573687    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8499ccbc4-9tjq8"]
Sep 11 21:36:57.574112 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.574097    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="066ab72b-f62d-4926-a5f9-f6491b698bcd" containerName="manager"
Sep 11 21:36:57.574176 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.574113    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="066ab72b-f62d-4926-a5f9-f6491b698bcd" containerName="manager"
Sep 11 21:36:57.574221 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.574199    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="066ab72b-f62d-4926-a5f9-f6491b698bcd" containerName="manager"
Sep 11 21:36:57.578712 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.578691    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.581286 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.581267    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ncdvn\""
Sep 11 21:36:57.582219 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.582201    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:36:57.582310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.582253    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:36:57.582310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.582267    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:36:57.593625 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.593604    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-9tjq8"]
Sep 11 21:36:57.712339 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.712313    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdvjd\" (UniqueName: \"kubernetes.io/projected/072dc3c0-ba37-4441-91dd-92b3e5859f5b-kube-api-access-wdvjd\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.712449 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.712352    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072dc3c0-ba37-4441-91dd-92b3e5859f5b-webhook-cert\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.712492 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.712459    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072dc3c0-ba37-4441-91dd-92b3e5859f5b-metrics-certs\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.812971 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.812946    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdvjd\" (UniqueName: \"kubernetes.io/projected/072dc3c0-ba37-4441-91dd-92b3e5859f5b-kube-api-access-wdvjd\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.813074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.812980    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072dc3c0-ba37-4441-91dd-92b3e5859f5b-webhook-cert\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.813074 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.813041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072dc3c0-ba37-4441-91dd-92b3e5859f5b-metrics-certs\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.815478 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.815451    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/072dc3c0-ba37-4441-91dd-92b3e5859f5b-webhook-cert\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.815620 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.815599    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/072dc3c0-ba37-4441-91dd-92b3e5859f5b-metrics-certs\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.822872 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.822853    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdvjd\" (UniqueName: \"kubernetes.io/projected/072dc3c0-ba37-4441-91dd-92b3e5859f5b-kube-api-access-wdvjd\") pod \"maas-controller-8499ccbc4-9tjq8\" (UID: \"072dc3c0-ba37-4441-91dd-92b3e5859f5b\") " pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:57.886248 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.886224    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="066ab72b-f62d-4926-a5f9-f6491b698bcd" path="/var/lib/kubelet/pods/066ab72b-f62d-4926-a5f9-f6491b698bcd/volumes"
Sep 11 21:36:57.889454 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:57.889437    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:58.168843 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:58.168812    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8499ccbc4-9tjq8"]
Sep 11 21:36:58.170880 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:36:58.170851    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072dc3c0_ba37_4441_91dd_92b3e5859f5b.slice/crio-0e79bd50d82c572950a91051900fbeea80e8a4d60076ab472537794476e3e249 WatchSource:0}: Error finding container 0e79bd50d82c572950a91051900fbeea80e8a4d60076ab472537794476e3e249: Status 404 returned error can't find the container with id 0e79bd50d82c572950a91051900fbeea80e8a4d60076ab472537794476e3e249
Sep 11 21:36:58.721535 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:58.721460    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-9tjq8" event={"ID":"072dc3c0-ba37-4441-91dd-92b3e5859f5b","Type":"ContainerStarted","Data":"072d4c63eb72cd3ce0c9316115f23d5c321f1a948d882b401c93a4302dd8310c"}
Sep 11 21:36:58.721535 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:58.721510    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8499ccbc4-9tjq8" event={"ID":"072dc3c0-ba37-4441-91dd-92b3e5859f5b","Type":"ContainerStarted","Data":"0e79bd50d82c572950a91051900fbeea80e8a4d60076ab472537794476e3e249"}
Sep 11 21:36:58.721913 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:58.721563    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:36:58.746472 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:36:58.746418    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8499ccbc4-9tjq8" podStartSLOduration=1.452721004 podStartE2EDuration="1.746402534s" totalImagesPullingTime="293.68153ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:58.743293853 +0000 UTC m=+1887.334807190" watchObservedRunningTime="2026-09-11 21:36:58.746402534 +0000 UTC m=+1887.337915856"
Sep 11 21:37:09.730262 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:37:09.730231    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8499ccbc4-9tjq8"
Sep 11 21:38:29.047180 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:38:29.047097    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:04.451699 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:39:04.451660    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:39:56.944530 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:39:56.944450    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:05.495171 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:05.495132    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:09.519886 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:09.519850    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:32.079897 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:32.079864    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:40:32.097577 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:32.097547    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:40:32.098747 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:32.098725    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:40:32.103924 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:32.103906    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-acl-logging/0.log"
Sep 11 21:40:34.039329 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:34.039294    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:35.746355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:35.746318    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:43.257504 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:43.257469    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:43.320485 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:43.320459    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:51.731946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:51.731905    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:40:54.700015 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.699978    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"]
Sep 11 21:40:54.704183 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.704159    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.715012 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.714983    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"]
Sep 11 21:40:54.805392 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.805361    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb7970c-4a32-4764-852e-c1aec83c9376-openshift-service-ca\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.805541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.805399    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swwgk\" (UniqueName: \"kubernetes.io/projected/4cb7970c-4a32-4764-852e-c1aec83c9376-kube-api-access-swwgk\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.805541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.805423    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb7970c-4a32-4764-852e-c1aec83c9376-maas-api-tls\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.805541 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.805449    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb7970c-4a32-4764-852e-c1aec83c9376-metrics-certs\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.906026 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.905992    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb7970c-4a32-4764-852e-c1aec83c9376-openshift-service-ca\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.906175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.906031    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swwgk\" (UniqueName: \"kubernetes.io/projected/4cb7970c-4a32-4764-852e-c1aec83c9376-kube-api-access-swwgk\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.906175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.906061    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb7970c-4a32-4764-852e-c1aec83c9376-maas-api-tls\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.906175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.906096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb7970c-4a32-4764-852e-c1aec83c9376-metrics-certs\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.906723 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.906703    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb7970c-4a32-4764-852e-c1aec83c9376-openshift-service-ca\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.908509 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.908489    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4cb7970c-4a32-4764-852e-c1aec83c9376-metrics-certs\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.908627 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.908604    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4cb7970c-4a32-4764-852e-c1aec83c9376-maas-api-tls\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:54.913524 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:54.913503    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swwgk\" (UniqueName: \"kubernetes.io/projected/4cb7970c-4a32-4764-852e-c1aec83c9376-kube-api-access-swwgk\") pod \"maas-api-5dfc94d75-j8jn7\" (UID: \"4cb7970c-4a32-4764-852e-c1aec83c9376\") " pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:55.017794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:55.017693    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:55.297623 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:55.297591    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"]
Sep 11 21:40:55.299285 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:40:55.299255    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cb7970c_4a32_4764_852e_c1aec83c9376.slice/crio-98d6e5cc9bf8484b415eaa77a7442d64c7138223030bf5aa10f2e8e6312f2d30 WatchSource:0}: Error finding container 98d6e5cc9bf8484b415eaa77a7442d64c7138223030bf5aa10f2e8e6312f2d30: Status 404 returned error can't find the container with id 98d6e5cc9bf8484b415eaa77a7442d64c7138223030bf5aa10f2e8e6312f2d30
Sep 11 21:40:55.301175 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:55.301152    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:40:56.101388 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:56.101353    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7" event={"ID":"4cb7970c-4a32-4764-852e-c1aec83c9376","Type":"ContainerStarted","Data":"98d6e5cc9bf8484b415eaa77a7442d64c7138223030bf5aa10f2e8e6312f2d30"}
Sep 11 21:40:57.108431 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:57.108400    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7" event={"ID":"4cb7970c-4a32-4764-852e-c1aec83c9376","Type":"ContainerStarted","Data":"cb721eebe1a09483473cfebc9bc6f8495524ceb933e373455872c07be7357e7f"}
Sep 11 21:40:57.108831 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:57.108468    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:40:57.130961 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:40:57.130914    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7" podStartSLOduration=1.868475535 podStartE2EDuration="3.130896838s" totalImagesPullingTime="1.262421303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:57.129295012 +0000 UTC m=+2125.720808349" watchObservedRunningTime="2026-09-11 21:40:57.130896838 +0000 UTC m=+2125.722410214"
Sep 11 21:41:03.119593 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:03.119562    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5dfc94d75-j8jn7"
Sep 11 21:41:12.380593 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:12.380556    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-jstg7"]
Sep 11 21:41:12.381186 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:12.380769    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7" podUID="b6100738-b0c0-42c1-b72e-397d492c30f2" containerName="maas-api" containerID="cri-o://8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc" gracePeriod=30
Sep 11 21:41:13.625497 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.625477    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:41:13.656482 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.656458    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6100738-b0c0-42c1-b72e-397d492c30f2-openshift-service-ca\") pod \"b6100738-b0c0-42c1-b72e-397d492c30f2\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") "
Sep 11 21:41:13.656603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.656511    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7c9rq\" (UniqueName: \"kubernetes.io/projected/b6100738-b0c0-42c1-b72e-397d492c30f2-kube-api-access-7c9rq\") pod \"b6100738-b0c0-42c1-b72e-397d492c30f2\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") "
Sep 11 21:41:13.656603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.656536    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-maas-api-tls\") pod \"b6100738-b0c0-42c1-b72e-397d492c30f2\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") "
Sep 11 21:41:13.656603 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.656576    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs\") pod \"b6100738-b0c0-42c1-b72e-397d492c30f2\" (UID: \"b6100738-b0c0-42c1-b72e-397d492c30f2\") "
Sep 11 21:41:13.656930 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.656898    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6100738-b0c0-42c1-b72e-397d492c30f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b6100738-b0c0-42c1-b72e-397d492c30f2" (UID: "b6100738-b0c0-42c1-b72e-397d492c30f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:41:13.658729 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.658694    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b6100738-b0c0-42c1-b72e-397d492c30f2" (UID: "b6100738-b0c0-42c1-b72e-397d492c30f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:41:13.658729 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.658722    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b6100738-b0c0-42c1-b72e-397d492c30f2" (UID: "b6100738-b0c0-42c1-b72e-397d492c30f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:41:13.659946 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.659927    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6100738-b0c0-42c1-b72e-397d492c30f2-kube-api-access-7c9rq" (OuterVolumeSpecName: "kube-api-access-7c9rq") pod "b6100738-b0c0-42c1-b72e-397d492c30f2" (UID: "b6100738-b0c0-42c1-b72e-397d492c30f2"). InnerVolumeSpecName "kube-api-access-7c9rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:41:13.757794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.757730    2585 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-metrics-certs\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:41:13.757794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.757756    2585 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6100738-b0c0-42c1-b72e-397d492c30f2-openshift-service-ca\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:41:13.757794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.757770    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7c9rq\" (UniqueName: \"kubernetes.io/projected/b6100738-b0c0-42c1-b72e-397d492c30f2-kube-api-access-7c9rq\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:41:13.757794 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:13.757782    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b6100738-b0c0-42c1-b72e-397d492c30f2-maas-api-tls\") on node \"ip-10-0-129-37.ec2.internal\" DevicePath \"\""
Sep 11 21:41:14.207202 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.207166    2585 generic.go:356] "Generic (PLEG): container finished" podID="b6100738-b0c0-42c1-b72e-397d492c30f2" containerID="8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc" exitCode=0
Sep 11 21:41:14.207401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.207209    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7"
Sep 11 21:41:14.207401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.207255    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7" event={"ID":"b6100738-b0c0-42c1-b72e-397d492c30f2","Type":"ContainerDied","Data":"8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc"}
Sep 11 21:41:14.207401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.207311    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-84585bc567-jstg7" event={"ID":"b6100738-b0c0-42c1-b72e-397d492c30f2","Type":"ContainerDied","Data":"df558765b84c8464316c39a75a390c6ed04e1a556e9800aa3a69b71e7aa918a4"}
Sep 11 21:41:14.207401 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.207336    2585 scope.go:117] "RemoveContainer" containerID="8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc"
Sep 11 21:41:14.217438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.217417    2585 scope.go:117] "RemoveContainer" containerID="8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc"
Sep 11 21:41:14.217750 ip-10-0-129-37 kubenswrapper[2585]: E0911 21:41:14.217723    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc\": container with ID starting with 8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc not found: ID does not exist" containerID="8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc"
Sep 11 21:41:14.217821 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.217758    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc"} err="failed to get container status \"8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc\": rpc error: code = NotFound desc = could not find container \"8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc\": container with ID starting with 8e9c7f0012796c0fd88afa9d6eef6855bff5e06afd20779fb1c612aee0f7eefc not found: ID does not exist"
Sep 11 21:41:14.225653 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.225604    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-jstg7"]
Sep 11 21:41:14.229380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:14.229357    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-84585bc567-jstg7"]
Sep 11 21:41:15.886258 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:15.886229    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6100738-b0c0-42c1-b72e-397d492c30f2" path="/var/lib/kubelet/pods/b6100738-b0c0-42c1-b72e-397d492c30f2/volumes"
Sep 11 21:41:30.131394 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:30.131310    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pp47s_cefc0a66-49d8-46b0-9906-dc95d456dbb5/manager/0.log"
Sep 11 21:41:30.382082 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:30.382005    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8499ccbc4-9tjq8_072dc3c0-ba37-4441-91dd-92b3e5859f5b/manager/0.log"
Sep 11 21:41:30.499617 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:30.499592    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5kgnj_1b6d7897-52e6-43b9-9494-f8363b2dd88e/server/0.log"
Sep 11 21:41:30.622277 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:30.622247    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z4bln_3f0c1bbf-723d-4869-950d-2c177a551ba6/manager/0.log"
Sep 11 21:41:30.984913 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:30.984885    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-ppjm7_90bd7345-dc5d-49a9-96aa-bf77224afd87/copy-manifests/0.log"
Sep 11 21:41:30.991373 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:30.991350    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-ppjm7_90bd7345-dc5d-49a9-96aa-bf77224afd87/manager/0.log"
Sep 11 21:41:31.349495 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:31.349470    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5dfc94d75-j8jn7_4cb7970c-4a32-4764-852e-c1aec83c9376/maas-api/0.log"
Sep 11 21:41:31.827891 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:31.827870    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-8vbqk_b9b8ac0b-8a3e-4336-9a44-9307df57388c/postgres/0.log"
Sep 11 21:41:32.704539 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:32.704515    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2m7hm_5e4b7a91-085b-4400-a765-6180d2b98318/manager/0.log"
Sep 11 21:41:32.816255 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:32.816232    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-c2s9b_b962a3ab-bc18-4375-90a9-8b6b858cba9b/manager/0.log"
Sep 11 21:41:33.784775 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:33.784746    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k8rzw_5a51c590-35f7-4e54-882c-8127c51eba43/discovery/0.log"
Sep 11 21:41:33.901740 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:33.901715    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677bd9b6b8-b9ttr_57819acd-2e12-4c03-999b-7b5dab70287a/kube-auth-proxy/0.log"
Sep 11 21:41:34.142840 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:34.142776    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/1.log"
Sep 11 21:41:34.501727 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:34.501667    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d9d59f4d8-jpdvl_4154bd61-7946-4587-a37e-a559590bdbd2/router/0.log"
Sep 11 21:41:34.848712 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:34.848686    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-nqg54_bac0837a-4d20-438d-a45c-717984d603ba/main/0.log"
Sep 11 21:41:34.966244 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:34.966215    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-bk92m_7bcf0da5-6342-4e62-8efd-b26284f5a896/main/0.log"
Sep 11 21:41:35.422824 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:35.422796    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-v7s97_068af4f9-229f-4437-bce9-2b30714dcf71/main/0.log"
Sep 11 21:41:41.455263 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:41.455230    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:41.548891 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:41.548867    2585 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log" limit=1024
Sep 11 21:41:44.409772 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:44.409728    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dz4bj_1de3c338-5441-4be4-a5b9-10645947fc29/global-pull-secret-syncer/0.log"
Sep 11 21:41:44.560870 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:44.560839    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-75tz9_658ea950-2c87-4b61-94f3-cd9dd8725957/konnectivity-agent/0.log"
Sep 11 21:41:44.643176 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:44.643151    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-37.ec2.internal_6abc4d8c8ce3d693c97b0f59444f7f92/haproxy/0.log"
Sep 11 21:41:49.452076 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:49.451982    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-2m7hm_5e4b7a91-085b-4400-a765-6180d2b98318/manager/0.log"
Sep 11 21:41:49.477634 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:49.477611    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-c2s9b_b962a3ab-bc18-4375-90a9-8b6b858cba9b/manager/0.log"
Sep 11 21:41:51.478301 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:51.478271    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-kcrk4_44c9aacc-e9a0-4505-862e-e202bff49aab/cluster-monitoring-operator/0.log"
Sep 11 21:41:51.790867 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:51.790826    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6r9sp_83b25cef-c375-4e32-83bf-6b81b41257ce/node-exporter/0.log"
Sep 11 21:41:51.815486 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:51.815465    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6r9sp_83b25cef-c375-4e32-83bf-6b81b41257ce/kube-rbac-proxy/0.log"
Sep 11 21:41:51.846873 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:51.846849    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6r9sp_83b25cef-c375-4e32-83bf-6b81b41257ce/init-textfile/0.log"
Sep 11 21:41:52.379934 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:52.379907    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-qldxl_06cdfbd9-a02a-43cf-9a08-fe6c3e9ceb0c/prometheus-operator-admission-webhook/0.log"
Sep 11 21:41:54.020978 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:54.020951    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-49qvx_1b128a79-25a9-44e2-950d-2d78e8f2b80c/networking-console-plugin/0.log"
Sep 11 21:41:54.658995 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:54.658967    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/1.log"
Sep 11 21:41:54.665459 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:54.665433    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-ftn4h_9cc689a1-3b4e-45c5-b63a-4415d530e14f/console-operator/2.log"
Sep 11 21:41:55.175514 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.175483    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"]
Sep 11 21:41:55.176310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.176283    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6100738-b0c0-42c1-b72e-397d492c30f2" containerName="maas-api"
Sep 11 21:41:55.176310 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.176309    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6100738-b0c0-42c1-b72e-397d492c30f2" containerName="maas-api"
Sep 11 21:41:55.176503 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.176414    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6100738-b0c0-42c1-b72e-397d492c30f2" containerName="maas-api"
Sep 11 21:41:55.179801 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.179779    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.183223 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.183196    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrqhg\"/\"openshift-service-ca.crt\""
Sep 11 21:41:55.183382 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.183355    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrqhg\"/\"kube-root-ca.crt\""
Sep 11 21:41:55.183561 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.183525    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nrqhg\"/\"default-dockercfg-bjkff\""
Sep 11 21:41:55.195921 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.195895    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"]
Sep 11 21:41:55.295263 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.295240    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzrv5\" (UniqueName: \"kubernetes.io/projected/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-kube-api-access-fzrv5\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.295377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.295272    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-lib-modules\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.295377 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.295297    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-proc\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.295496 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.295447    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-sys\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.295496 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.295483    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-podres\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.321828 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.321802    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-f5zv2_1983e359-6f83-4b36-bc3e-ee1bf6fd711d/download-server/0.log"
Sep 11 21:41:55.396346 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396323    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-sys\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396453 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396352    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-podres\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396453 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396405    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzrv5\" (UniqueName: \"kubernetes.io/projected/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-kube-api-access-fzrv5\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396453 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-lib-modules\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396470    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-proc\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396436    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-sys\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396527    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-podres\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396554    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-lib-modules\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.396616 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.396595    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-proc\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.405080 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.405062    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzrv5\" (UniqueName: \"kubernetes.io/projected/c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2-kube-api-access-fzrv5\") pod \"perf-node-gather-daemonset-dplkb\" (UID: \"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2\") " pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.490380 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.490321    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:55.765081 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:55.765051    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"]
Sep 11 21:41:55.766437 ip-10-0-129-37 kubenswrapper[2585]: W0911 21:41:55.766408    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8bf2fcd_58a7_4c0f_a258_5134e44e2ea2.slice/crio-ea65bfcfe416d00379861788ea700fd21fb91707e9fa08d398d22cea2ca2d376 WatchSource:0}: Error finding container ea65bfcfe416d00379861788ea700fd21fb91707e9fa08d398d22cea2ca2d376: Status 404 returned error can't find the container with id ea65bfcfe416d00379861788ea700fd21fb91707e9fa08d398d22cea2ca2d376
Sep 11 21:41:56.090358 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:56.090335    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-4ms9n_4c261c7a-d759-43f9-956b-753b0a2f61cf/volume-data-source-validator/0.log"
Sep 11 21:41:56.450703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:56.450606    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb" event={"ID":"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2","Type":"ContainerStarted","Data":"939d3d7bdf9ecb44e892583ef7983b1238acf0120532dec0189cbdca9719e3b5"}
Sep 11 21:41:56.450703 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:56.450696    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:41:56.451076 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:56.450722    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb" event={"ID":"c8bf2fcd-58a7-4c0f-a258-5134e44e2ea2","Type":"ContainerStarted","Data":"ea65bfcfe416d00379861788ea700fd21fb91707e9fa08d398d22cea2ca2d376"}
Sep 11 21:41:56.476570 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:56.476513    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb" podStartSLOduration=1.476496481 podStartE2EDuration="1.476496481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:56.473999803 +0000 UTC m=+2185.065513125" watchObservedRunningTime="2026-09-11 21:41:56.476496481 +0000 UTC m=+2185.068009871"
Sep 11 21:41:57.260229 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:57.260197    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgv57_d6164295-ad3b-4b87-a92a-00a79fb58bcc/dns/0.log"
Sep 11 21:41:57.295036 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:57.295013    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qgv57_d6164295-ad3b-4b87-a92a-00a79fb58bcc/kube-rbac-proxy/0.log"
Sep 11 21:41:57.410894 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:57.410871    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tdx6l_79192859-1f89-4395-b14a-e52bee7a6950/dns-node-resolver/0.log"
Sep 11 21:41:58.082416 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:58.082383    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dmszh_ae1c9348-76bf-4b45-90a0-35d9aa36cfe7/node-ca/0.log"
Sep 11 21:41:59.331355 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:59.331331    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k8rzw_5a51c590-35f7-4e54-882c-8127c51eba43/discovery/0.log"
Sep 11 21:41:59.350424 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:59.350389    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677bd9b6b8-b9ttr_57819acd-2e12-4c03-999b-7b5dab70287a/kube-auth-proxy/0.log"
Sep 11 21:41:59.404529 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:59.404507    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/0.log"
Sep 11 21:41:59.407017 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:59.406999    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/1.log"
Sep 11 21:41:59.500675 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:41:59.500655    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d9d59f4d8-jpdvl_4154bd61-7946-4587-a37e-a559590bdbd2/router/0.log"
Sep 11 21:42:00.381035 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:00.381008    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gzrnn_eb07137d-3e54-4088-a37a-3cf63fc4ab60/serve-healthcheck-canary/0.log"
Sep 11 21:42:00.875371 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:00.875343    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-vmqkc_dad7fe4e-7346-4bb7-9bd4-627c051b169b/insights-operator/0.log"
Sep 11 21:42:00.875802 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:00.875781    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-vmqkc_dad7fe4e-7346-4bb7-9bd4-627c051b169b/insights-operator/1.log"
Sep 11 21:42:00.895659 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:00.895602    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cq74_8f324793-6fe5-4203-80e7-edcfd9556220/kube-rbac-proxy/0.log"
Sep 11 21:42:00.916366 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:00.916345    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cq74_8f324793-6fe5-4203-80e7-edcfd9556220/exporter/0.log"
Sep 11 21:42:00.938438 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:00.938413    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8cq74_8f324793-6fe5-4203-80e7-edcfd9556220/extractor/0.log"
Sep 11 21:42:02.467767 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:02.467740    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nrqhg/perf-node-gather-daemonset-dplkb"
Sep 11 21:42:03.228430 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:03.228395    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pp47s_cefc0a66-49d8-46b0-9906-dc95d456dbb5/manager/0.log"
Sep 11 21:42:03.520358 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:03.520281    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-8499ccbc4-9tjq8_072dc3c0-ba37-4441-91dd-92b3e5859f5b/manager/0.log"
Sep 11 21:42:03.538695 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:03.538672    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5kgnj_1b6d7897-52e6-43b9-9494-f8363b2dd88e/server/0.log"
Sep 11 21:42:03.612931 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:03.612909    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-z4bln_3f0c1bbf-723d-4869-950d-2c177a551ba6/manager/0.log"
Sep 11 21:42:03.768475 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:03.768451    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-ppjm7_90bd7345-dc5d-49a9-96aa-bf77224afd87/manager/0.log"
Sep 11 21:42:03.787406 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:03.787388    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8457b95c77-ppjm7_90bd7345-dc5d-49a9-96aa-bf77224afd87/copy-manifests/0.log"
Sep 11 21:42:05.153871 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:05.153809    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k8rzw_5a51c590-35f7-4e54-882c-8127c51eba43/discovery/0.log"
Sep 11 21:42:05.165403 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:05.165377    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677bd9b6b8-b9ttr_57819acd-2e12-4c03-999b-7b5dab70287a/kube-auth-proxy/0.log"
Sep 11 21:42:05.202789 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:05.202765    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/0.log"
Sep 11 21:42:05.205114 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:05.205099    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/1.log"
Sep 11 21:42:05.268300 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:05.268279    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d9d59f4d8-jpdvl_4154bd61-7946-4587-a37e-a559590bdbd2/router/0.log"
Sep 11 21:42:07.184358 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:07.184330    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-k8rzw_5a51c590-35f7-4e54-882c-8127c51eba43/discovery/0.log"
Sep 11 21:42:07.210815 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:07.210792    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-677bd9b6b8-b9ttr_57819acd-2e12-4c03-999b-7b5dab70287a/kube-auth-proxy/0.log"
Sep 11 21:42:07.283879 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:07.283837    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/0.log"
Sep 11 21:42:07.286255 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:07.286236    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-2rp55_b4a2e5fa-e99f-48c8-8a3b-3ad1adddd1b2/istio-proxy/1.log"
Sep 11 21:42:07.409781 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:07.409761    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d9d59f4d8-jpdvl_4154bd61-7946-4587-a37e-a559590bdbd2/router/0.log"
Sep 11 21:42:10.799019 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:10.798885    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-ckjp9_c109a323-4cea-41be-82c8-34a7d7f286cb/kube-storage-version-migrator-operator/1.log"
Sep 11 21:42:10.800142 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:10.800113    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-ckjp9_c109a323-4cea-41be-82c8-34a7d7f286cb/kube-storage-version-migrator-operator/0.log"
Sep 11 21:42:11.859520 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.859490    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/kube-multus-additional-cni-plugins/0.log"
Sep 11 21:42:11.879500 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.879477    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/egress-router-binary-copy/0.log"
Sep 11 21:42:11.899732 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.899711    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/cni-plugins/0.log"
Sep 11 21:42:11.918858 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.918839    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/bond-cni-plugin/0.log"
Sep 11 21:42:11.938927 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.938908    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/routeoverride-cni/0.log"
Sep 11 21:42:11.959202 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.959183    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/whereabouts-cni-bincopy/0.log"
Sep 11 21:42:11.983177 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:11.983159    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbxxn_001078c7-c95f-4cb5-922c-d4ee0f1beecf/whereabouts-cni/0.log"
Sep 11 21:42:12.345318 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:12.345289    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cc287_a137b21b-063b-4b9a-8b87-7a5e550cb98e/kube-multus/0.log"
Sep 11 21:42:12.541305 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:12.541278    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm2zj_1a457fc6-a504-442e-9933-c616c05738ad/network-metrics-daemon/0.log"
Sep 11 21:42:12.558876 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:12.558852    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rm2zj_1a457fc6-a504-442e-9933-c616c05738ad/kube-rbac-proxy/0.log"
Sep 11 21:42:13.940693 ip-10-0-129-37 kubenswrapper[2585]: I0911 21:42:13.940663    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xhqsv_d7434344-3ab9-4250-9f03-d548af3bb9a4/ovn-controller/0.log"