Sep 08 16:30:04.183154 ip-10-0-129-146 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 16:30:04.621810 ip-10-0-129-146 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:30:04.621810 ip-10-0-129-146 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 16:30:04.621810 ip-10-0-129-146 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:30:04.621810 ip-10-0-129-146 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 16:30:04.621810 ip-10-0-129-146 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:30:04.624691 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.624595    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 16:30:04.628946 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628925    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:04.628946 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628944    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:04.628946 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628948    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628952    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628956    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628959    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628963    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628971    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628974    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628977    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628980    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628982    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628985    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628988    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628991    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628993    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628996    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.628999    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629001    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629004    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629006    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629009    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:04.629048 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629012    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629015    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629018    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629021    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629023    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629025    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629028    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629032    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629036    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629039    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629041    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629044    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629048    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629051    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629054    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629056    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629060    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629062    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629065    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:04.629524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629067    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629071    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629073    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629078    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629081    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629084    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629087    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629089    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629093    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629096    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629098    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629101    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629103    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629106    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629109    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629111    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629114    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629117    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629119    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629122    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:04.630037 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629124    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629126    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629129    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629131    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629134    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629136    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629139    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629141    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629143    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629146    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629149    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629152    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629154    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629157    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629159    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629161    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629164    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629166    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629169    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629171    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:04.630524 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629174    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629176    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629179    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629183    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629186    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629189    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629192    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629194    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629197    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629200    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629202    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629205    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629207    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629210    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629212    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629215    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629217    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629219    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629953    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629960    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:04.631032 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629963    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629965    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629968    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629973    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629976    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629979    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629982    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629984    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629987    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629990    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629992    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629995    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.629997    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630000    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630002    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630005    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630007    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630009    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630012    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630014    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:04.631511 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630017    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630020    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630023    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630026    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630028    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630031    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630033    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630035    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630038    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630041    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630044    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630046    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630049    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630051    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630054    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630056    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630060    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630063    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630065    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630068    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:04.632026 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630070    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630074    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630076    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630079    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630082    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630084    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630088    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630092    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630096    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630099    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630102    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630105    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630107    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630113    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630116    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630119    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630122    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630125    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630128    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:04.632513 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630130    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630133    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630135    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630138    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630140    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630143    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630145    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630148    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630152    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630155    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630166    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630169    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630172    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630174    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630177    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630179    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630182    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630184    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630187    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:04.632999 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630189    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630192    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630194    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630196    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630199    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630201    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630204    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630208    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630210    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630213    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630218    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630220    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630223    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630225    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630228    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630231    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630233    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630236    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630238    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:04.633486 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630635    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630640    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630642    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630645    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630648    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630651    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630654    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630656    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630659    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630661    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630663    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630666    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630668    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630671    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630673    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630675    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630678    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630680    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630682    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630685    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:04.633988 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630691    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630695    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630698    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630701    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630704    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630706    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630709    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630712    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630715    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630717    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630720    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630724    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630727    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630730    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630733    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630736    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630738    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630743    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630746    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:04.634466 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630749    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630751    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630754    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630756    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630759    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630761    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630763    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630766    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630768    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630770    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630773    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630790    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630793    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630798    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630800    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630803    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630806    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630808    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630811    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630813    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:04.635030 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630817    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630820    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630822    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630825    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630827    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630830    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630833    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630835    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630838    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630840    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630844    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630848    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630850    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630854    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630857    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630859    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630862    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630864    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630866    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:04.635579 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630869    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630871    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630874    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630876    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630879    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630881    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630886    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630888    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630891    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630893    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630896    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630898    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630901    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630903    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630906    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630908    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630910    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630913    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630916    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630918    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:04.636112 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.630921    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631014    2547 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631058    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631066    2547 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631071    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631077    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631080    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631085    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631090    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631093    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631097    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631100    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631104    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631107    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631110    2547 flags.go:64] FLAG: --cgroup-root=""
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631113    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631116    2547 flags.go:64] FLAG: --client-ca-file=""
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631118    2547 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631122    2547 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631127    2547 flags.go:64] FLAG: --cluster-domain=""
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631130    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631133    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631136    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631139    2547 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 16:30:04.636700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631143    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631146    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631149    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631152    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631155    2547 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631158    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631161    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631163    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631168    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631172    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631175    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631179    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631182    2547 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631185    2547 flags.go:64] FLAG: --enable-server="true"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631193    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631198    2547 flags.go:64] FLAG: --event-burst="100"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631201    2547 flags.go:64] FLAG: --event-qps="50"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631203    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631206    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631209    2547 flags.go:64] FLAG: --eviction-hard=""
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631213    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631215    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631218    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631221    2547 flags.go:64] FLAG: --eviction-soft=""
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631224    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 16:30:04.637465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631227    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631230    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631233    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631236    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631239    2547 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631241    2547 flags.go:64] FLAG: --feature-gates=""
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631245    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631248    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631251    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631254    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631257    2547 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631260    2547 flags.go:64] FLAG: --help="false"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631263    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-129-146.ec2.internal"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631266    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631269    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631272    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631275    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631278    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631283    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631286    2547 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631288    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631291    2547 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631294    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631297    2547 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 16:30:04.638183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631300    2547 flags.go:64] FLAG: --kube-reserved=""
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631303    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631305    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631309    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631311    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631314    2547 flags.go:64] FLAG: --lock-file=""
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631317    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631320    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631323    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631328    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631331    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631334    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631336    2547 flags.go:64] FLAG: --logging-format="text"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631339    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631342    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631345    2547 flags.go:64] FLAG: --manifest-url=""
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631348    2547 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631352    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631355    2547 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631359    2547 flags.go:64] FLAG: --max-pods="110"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631362    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631365    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631367    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631370    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631373    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 16:30:04.638865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631376    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631381    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631389    2547 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631392    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631395    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631398    2547 flags.go:64] FLAG: --pod-cidr=""
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631401    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631407    2547 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631410    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631413    2547 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631416    2547 flags.go:64] FLAG: --port="10250"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631419    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631422    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c2816250c652e4d6"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631425    2547 flags.go:64] FLAG: --qos-reserved=""
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631428    2547 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631431    2547 flags.go:64] FLAG: --register-node="true"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631434    2547 flags.go:64] FLAG: --register-with-taints=""
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631437    2547 flags.go:64] FLAG: --registry-burst="10"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631440    2547 flags.go:64] FLAG: --registry-qps="5"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631443    2547 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631445    2547 flags.go:64] FLAG: --reserved-memory=""
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631449    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631452    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631454    2547 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631457    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 16:30:04.639521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631460    2547 flags.go:64] FLAG: --runonce="false"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631463    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631466    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631468    2547 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631471    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631474    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631478    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631480    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631485    2547 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631487    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631490    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631493    2547 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631496    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631498    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631503    2547 flags.go:64] FLAG: --system-cgroups=""
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631506    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631513    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631516    2547 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631519    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631524    2547 flags.go:64] FLAG: --tls-min-version=""
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631527    2547 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631529    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631532    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631535    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631538    2547 flags.go:64] FLAG: --v="2"
Sep 08 16:30:04.640155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631542    2547 flags.go:64] FLAG: --version="false"
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631547    2547 flags.go:64] FLAG: --vmodule=""
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631550    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.631553    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631670    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631674    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631677    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631680    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631683    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631687    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631690    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631693    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631696    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631699    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631703    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631708    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631711    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631713    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631716    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631719    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:04.640827 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631722    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631726    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631729    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631732    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631734    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631737    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631739    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631742    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631744    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631747    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631750    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631752    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631756    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631759    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631762    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631765    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631768    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631771    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631773    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631790    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:04.641317 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631793    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631796    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631798    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631801    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631804    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631806    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631809    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631812    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631815    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631817    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631820    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631822    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631825    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631829    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631831    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631834    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631837    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631840    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631842    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:04.641831 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631845    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631847    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631850    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631853    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631855    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631858    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631860    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631863    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631865    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631868    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631870    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631873    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631875    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631878    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631880    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631883    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631885    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631889    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631892    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:04.642307 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631895    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631899    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631902    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631904    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631907    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631910    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631912    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631916    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631919    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631921    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631924    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631927    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631929    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631932    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631935    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631937    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631940    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631942    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631945    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631947    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:04.642758 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631949    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631952    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631955    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631957    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.631960    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.632690    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.640743    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.640761    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.641653    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.641661    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641726    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641732    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641735    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641738    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:04.643271 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641741    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641744    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641748    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641750    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641753    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641756    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641758    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641761    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641765    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641767    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641770    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641772    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641775    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641789    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641792    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641795    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641797    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641800    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641803    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641806    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641808    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:04.643631 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641811    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641815    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641820    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641823    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641827    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641830    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641832    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641836    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641839    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641841    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641844    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641847    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641850    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641853    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641855    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641858    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641861    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641864    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641866    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:04.644191 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641869    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641873    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641876    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641879    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641882    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641885    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641888    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641891    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641894    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641897    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641899    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641902    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641904    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641906    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641909    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641912    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641914    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641917    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641920    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:04.644664 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641923    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641926    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641928    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641931    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641933    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641937    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641941    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641944    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641947    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641950    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641952    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641955    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641958    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641960    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641963    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641966    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641969    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641971    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641974    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:04.645137 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641977    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641979    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641983    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641986    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641989    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641992    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641994    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.641997    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642000    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642002    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642005    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642008    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642011    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642013    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642016    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642019    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:04.645599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642021    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.642026    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642146    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642152    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642155    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642157    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642160    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642162    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642165    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642167    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642170    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642172    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642175    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642178    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642180    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:04.646120 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642183    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642185    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642188    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642190    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642193    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642197    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642201    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642203    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642206    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642209    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642211    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642213    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642216    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642219    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642221    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642224    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642226    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642229    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642231    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642234    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:04.646475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642236    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642239    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642241    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642243    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642246    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642248    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642251    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642253    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642255    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642258    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642260    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642263    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642266    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642268    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642271    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642273    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642276    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642278    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642280    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:04.646986 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642283    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642285    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642288    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642290    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642293    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642295    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642298    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642300    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642302    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642305    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642307    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642310    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642314    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642317    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642321    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642323    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642326    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642329    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642331    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:04.647443 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642333    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642336    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642338    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642341    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642343    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642346    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642349    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642352    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642354    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642357    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642359    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642361    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642364    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642366    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642368    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642371    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642373    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642376    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642378    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642381    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:04.647908 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642384    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642388    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642391    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642393    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642396    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642398    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642401    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:04.642403    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.642408    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.642539    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.645935    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.647052    2547 server.go:1019] "Starting client certificate rotation"
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.647155    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 16:30:04.648376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.647206    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 16:30:04.651705 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.651689    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 16:30:04.653346 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.653324    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 16:30:04.663702 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.663679    2547 log.go:25] "Validated CRI v1 runtime API"
Sep 08 16:30:04.668100 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.668080    2547 log.go:25] "Validated CRI v1 image API"
Sep 08 16:30:04.668985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.668969    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 16:30:04.672982 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.672953    2547 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c373cb89-2517-4315-9055-41fb5af7e900:/dev/nvme0n1p3 f9b43f5b-d872-43c2-a466-08e8aec97789:/dev/nvme0n1p4]
Sep 08 16:30:04.673061 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.672981    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 16:30:04.678468 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.678340    2547 manager.go:216] Machine: {Timestamp:2026-09-08 16:30:04.676931556 +0000 UTC m=+0.380774547 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100367 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22dbb32a343013bbf0ebf50e56049d SystemUUID:ec22dbb3-2a34-3013-bbf0-ebf50e56049d BootID:d5214c73-fbe4-463c-a777-88f60f5e9777 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:95:83:8f:25:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:95:83:8f:25:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:e2:f5:94:62:c3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 16:30:04.678468 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.678457    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 16:30:04.678652 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.678578    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 16:30:04.682039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.682004    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 16:30:04.682222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.682044    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-146.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 16:30:04.682995 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.682981    2547 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 16:30:04.683059 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.683001    2547 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 16:30:04.683059 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.683013    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 16:30:04.683059 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.683032    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 16:30:04.685080 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.685066    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 16:30:04.687077 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.687058    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 16:30:04.689709 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689696    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 16:30:04.689893 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689882    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 16:30:04.689977 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689913    2547 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 16:30:04.689977 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689924    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 16:30:04.689977 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689941    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 16:30:04.689977 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689951    2547 kubelet.go:398] "Adding apiserver pod source"
Sep 08 16:30:04.689977 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.689963    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 16:30:04.690357 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.690346    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 16:30:04.690389 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.690366    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 16:30:04.692838 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.692822    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 16:30:04.696112 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.696095    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 16:30:04.696190 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.696134    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 16:30:04.697067 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697052    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 16:30:04.697138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697076    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 16:30:04.697138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697085    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 16:30:04.697138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697095    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 16:30:04.697138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697107    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 16:30:04.697138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697116    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 16:30:04.697322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697146    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 16:30:04.697322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697155    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 16:30:04.697322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697165    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 16:30:04.697322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697174    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 16:30:04.697322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697192    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 16:30:04.697322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.697207    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 16:30:04.698116 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.698104    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 16:30:04.698165 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.698117    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 16:30:04.702235 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.702219    2547 server.go:1268] "Started kubelet"
Sep 08 16:30:04.702334 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.702263    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 16:30:04.702375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.702323    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 16:30:04.702420 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.702394    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 16:30:04.703242 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.703215    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-146.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 16:30:04.703345 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.703286    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 16:30:04.703345 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.703293    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 16:30:04.703244 ip-10-0-129-146 systemd[1]: Started Kubernetes Kubelet.
Sep 08 16:30:04.707579 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.707558    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 16:30:04.708727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.708708    2547 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 16:30:04.710358 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.710335    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 16:30:04.713285 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.713269    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 16:30:04.713956 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.713939    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 16:30:04.714061 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.714019    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:04.714673 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714656    2547 factory.go:55] Registering systemd factory
Sep 08 16:30:04.714673 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714674    2547 factory.go:223] Registration of the systemd container factory successfully
Sep 08 16:30:04.714805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714741    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 16:30:04.714805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714743    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 16:30:04.714805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714763    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 16:30:04.714940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714925    2547 factory.go:153] Registering CRI-O factory
Sep 08 16:30:04.715000 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.714944    2547 factory.go:223] Registration of the crio container factory successfully
Sep 08 16:30:04.715237 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.715011    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 16:30:04.715237 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.713827    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-146.ec2.internal.18d3656f114988f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-146.ec2.internal,UID:ip-10-0-129-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-146.ec2.internal,},FirstTimestamp:2026-09-08 16:30:04.702025976 +0000 UTC m=+0.405869019,LastTimestamp:2026-09-08 16:30:04.702025976 +0000 UTC m=+0.405869019,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-146.ec2.internal,}"
Sep 08 16:30:04.715237 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.715032    2547 factory.go:103] Registering Raw factory
Sep 08 16:30:04.715237 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.715063    2547 manager.go:1196] Started watching for new ooms in manager
Sep 08 16:30:04.715713 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.715464    2547 manager.go:349] Starting recovery of all containers
Sep 08 16:30:04.716070 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.716051    2547 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 16:30:04.716070 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.716068    2547 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 16:30:04.725485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.725290    2547 manager.go:354] Recovery completed
Sep 08 16:30:04.726615 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.726593    2547 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 08 16:30:04.727368 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.727337    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-146.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 16:30:04.727368 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.727359    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 16:30:04.729668 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.729654    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.731429 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731412    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.731505 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731442    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.731505 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731453    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.731981 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731961    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 16:30:04.731981 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731980    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 16:30:04.732098 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731990    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.732098 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.731999    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 16:30:04.732669 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.732653    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.732715 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.732680    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.732715 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.732690    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.734254 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.734243    2547 policy_none.go:49] "None policy: Start"
Sep 08 16:30:04.734302 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.734260    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 16:30:04.734302 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.734270    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 16:30:04.736244 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.736233    2547 policy_none.go:47] "Start"
Sep 08 16:30:04.741002 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.740932    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-146.ec2.internal.18d3656f130a2c51  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-146.ec2.internal,UID:ip-10-0-129-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-146.ec2.internal,},FirstTimestamp:2026-09-08 16:30:04.731427921 +0000 UTC m=+0.435270912,LastTimestamp:2026-09-08 16:30:04.731427921 +0000 UTC m=+0.435270912,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-146.ec2.internal,}"
Sep 08 16:30:04.747894 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.747822    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-146.ec2.internal.18d3656f130a766d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-146.ec2.internal,UID:ip-10-0-129-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-129-146.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-129-146.ec2.internal,},FirstTimestamp:2026-09-08 16:30:04.731446893 +0000 UTC m=+0.435289884,LastTimestamp:2026-09-08 16:30:04.731446893 +0000 UTC m=+0.435289884,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-146.ec2.internal,}"
Sep 08 16:30:04.758985 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.758886    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-146.ec2.internal.18d3656f130a9b71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-146.ec2.internal,UID:ip-10-0-129-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-129-146.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-129-146.ec2.internal,},FirstTimestamp:2026-09-08 16:30:04.731456369 +0000 UTC m=+0.435299360,LastTimestamp:2026-09-08 16:30:04.731456369 +0000 UTC m=+0.435299360,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-146.ec2.internal,}"
Sep 08 16:30:04.764474 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.764277    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kf5vp"
Sep 08 16:30:04.771975 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.771889    2547 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-129-146.ec2.internal.18d3656f130a2c51\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-146.ec2.internal.18d3656f130a2c51  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-146.ec2.internal,UID:ip-10-0-129-146.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-146.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-146.ec2.internal,},FirstTimestamp:2026-09-08 16:30:04.731427921 +0000 UTC m=+0.435270912,LastTimestamp:2026-09-08 16:30:04.732668623 +0000 UTC m=+0.436511614,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-146.ec2.internal,}"
Sep 08 16:30:04.772108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.772042    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kf5vp"
Sep 08 16:30:04.778463 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.778446    2547 manager.go:337] "Starting Device Plugin manager"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.778488    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.778504    2547 server.go:87] "Starting device plugin registration server"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.778807    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.778819    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.778962    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.779063    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.779073    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.779610    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 16:30:04.800149 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.779664    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:04.824586 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.824547    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 16:30:04.825961 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.825943    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 16:30:04.826021 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.826007    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 16:30:04.826055 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.826037    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 16:30:04.826100 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.826085    2547 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 16:30:04.828431 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.828399    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:04.879561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.879480    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.880473 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.880455    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.880546 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.880489    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.880546 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.880500    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.880546 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.880525    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-146.ec2.internal"
Sep 08 16:30:04.888596 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.888576    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-146.ec2.internal"
Sep 08 16:30:04.888696 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.888604    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-146.ec2.internal\": node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:04.923377 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.923340    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:04.926427 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.926403    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"]
Sep 08 16:30:04.926500 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.926491    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.928528 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.928501    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.928528 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.928531    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.928701 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.928541    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.930887 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.930872    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.931022 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.931008    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:04.931062 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.931047    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.932116 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.932100    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.932203 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.932127    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.932203 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.932103    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.932203 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.932138    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.932203 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.932155    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.932203 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.932167    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.934371 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.934355    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:04.934459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.934382    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:04.936073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.936056    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:04.936170 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.936091    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:04.936170 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:04.936106    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:04.961595 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.961558    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-146.ec2.internal\" not found" node="ip-10-0-129-146.ec2.internal"
Sep 08 16:30:04.965997 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:04.965980    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-146.ec2.internal\" not found" node="ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.017973 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.017937    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d914bb912e7494f7b37b4c668e9e45d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal\" (UID: \"8d914bb912e7494f7b37b4c668e9e45d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.018113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.017977    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d914bb912e7494f7b37b4c668e9e45d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal\" (UID: \"8d914bb912e7494f7b37b4c668e9e45d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.018113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.018019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3942b755a80943cc8a080b1a44e287c8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-146.ec2.internal\" (UID: \"3942b755a80943cc8a080b1a44e287c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.024053 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.024029    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.118867 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.118824    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d914bb912e7494f7b37b4c668e9e45d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal\" (UID: \"8d914bb912e7494f7b37b4c668e9e45d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.118867 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.118869    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d914bb912e7494f7b37b4c668e9e45d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal\" (UID: \"8d914bb912e7494f7b37b4c668e9e45d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.119033 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.118887    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3942b755a80943cc8a080b1a44e287c8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-146.ec2.internal\" (UID: \"3942b755a80943cc8a080b1a44e287c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.119033 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.118939    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3942b755a80943cc8a080b1a44e287c8-config\") pod \"kube-apiserver-proxy-ip-10-0-129-146.ec2.internal\" (UID: \"3942b755a80943cc8a080b1a44e287c8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.119033 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.118960    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d914bb912e7494f7b37b4c668e9e45d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal\" (UID: \"8d914bb912e7494f7b37b4c668e9e45d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.119033 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.118972    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d914bb912e7494f7b37b4c668e9e45d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal\" (UID: \"8d914bb912e7494f7b37b4c668e9e45d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.124922 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.124901    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.225667 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.225585    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.264796 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.264755    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.268610 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.268592    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.326645 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.326593    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.427129 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.427080    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.527691 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.527605    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.628170 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.628133    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.646257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.646224    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 16:30:05.646390 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.646374    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 16:30:05.687684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.687650    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:05.728853 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.728823    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.775049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.775001    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 16:25:05 +0000 UTC" deadline="2028-02-25 07:45:16.868179962 +0000 UTC"
Sep 08 16:30:05.775049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.775040    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12831h15m11.093143578s"
Sep 08 16:30:05.784355 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.784305    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:05.785338 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.785322    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:05.785419 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.785355    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:05.785419 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.785369    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:05.828917 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:05.828884    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-146.ec2.internal\" not found"
Sep 08 16:30:05.841959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.841931    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:05.914969 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.914928    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.934708 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.934681    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 16:30:05.936147 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.936131    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal"
Sep 08 16:30:05.948386 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:05.948366    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 16:30:06.098010 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:06.097976    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3942b755a80943cc8a080b1a44e287c8.slice/crio-6dce495aa067c7a5dcf0710f3dc10e9347d8fd535ad850d7ff2e4a3b0b8e3fa1 WatchSource:0}: Error finding container 6dce495aa067c7a5dcf0710f3dc10e9347d8fd535ad850d7ff2e4a3b0b8e3fa1: Status 404 returned error can't find the container with id 6dce495aa067c7a5dcf0710f3dc10e9347d8fd535ad850d7ff2e4a3b0b8e3fa1
Sep 08 16:30:06.098473 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:06.098458    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d914bb912e7494f7b37b4c668e9e45d.slice/crio-8042c3f61491ea516b3cd085d2dcb8dab6ee75fc441b35c4e84c74ce5dcbf09f WatchSource:0}: Error finding container 8042c3f61491ea516b3cd085d2dcb8dab6ee75fc441b35c4e84c74ce5dcbf09f: Status 404 returned error can't find the container with id 8042c3f61491ea516b3cd085d2dcb8dab6ee75fc441b35c4e84c74ce5dcbf09f
Sep 08 16:30:06.103641 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.103621    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:30:06.310352 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.310264    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:06.691854 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.691734    2547 apiserver.go:52] "Watching apiserver"
Sep 08 16:30:06.698394 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.698362    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 16:30:06.700381 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.700356    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-4nnb6","openshift-multus/multus-additional-cni-plugins-cpclg","openshift-dns/node-resolver-mzbwf","openshift-image-registry/node-ca-htghg","openshift-multus/network-metrics-daemon-cswl9","openshift-network-diagnostics/network-check-target-ls2d6","openshift-network-operator/iptables-alerter-vs6c9","openshift-ovn-kubernetes/ovnkube-node-4qz6l","kube-system/global-pull-secret-syncer-qkf2f","kube-system/konnectivity-agent-zkxfs","kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b","openshift-cluster-node-tuning-operator/tuned-c4pc8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal"]
Sep 08 16:30:06.704505 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.704480    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.706718 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.706688    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.707038 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.707001    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 16:30:06.707151 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.707122    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rcwqc\""
Sep 08 16:30:06.707199 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.707160    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 16:30:06.708771 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.708737    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bl5d2\""
Sep 08 16:30:06.709076 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.709059    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.709172 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.709095    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.709172 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.709118    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.711341 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711312    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 16:30:06.711455 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711354    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkw95\""
Sep 08 16:30:06.711899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711542    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 16:30:06.711899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711570    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.711899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711581    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.711899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711798    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 16:30:06.711899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711841    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 16:30:06.712164 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.711920    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.714025 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.714009    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 16:30:06.714327 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.714309    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 16:30:06.714415 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.714371    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:06.714552 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.714510    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:06.714706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.714690    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.714805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.714775    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xnw89\""
Sep 08 16:30:06.714805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.714797    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.716762 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.716746    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:06.716872 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.716836    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:06.719615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.719600    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.722109 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.722092    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.722271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.722252    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 16:30:06.722339 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.722257    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ps52j\""
Sep 08 16:30:06.724073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.724055    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.724482 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.724356    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.724667 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.724559    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.724898 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.724876    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8dnfs\""
Sep 08 16:30:06.724985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.724902    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.725058 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.724879    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.725386 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.725366    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 16:30:06.725491 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.725473    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 16:30:06.727157 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.727134    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.727235 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.727210    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:06.727456 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.727440    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 16:30:06.728152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728132    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thc8j\" (UniqueName: \"kubernetes.io/projected/9ddda861-4189-4019-918a-ee3d1a2e991a-kube-api-access-thc8j\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.728234 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-systemd\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.728234 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728202    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n668w\" (UniqueName: \"kubernetes.io/projected/b4798fd5-9752-48e5-902b-ba3223f7e3f7-kube-api-access-n668w\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.728340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728230    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-socket-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.728340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728257    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-device-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.728340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728289    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-etc-selinux\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.728340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728305    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 16:30:06.728533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728325    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c70a299b-1c8a-4402-8c72-881dc3e73ab8-konnectivity-ca\") pod \"konnectivity-agent-zkxfs\" (UID: \"c70a299b-1c8a-4402-8c72-881dc3e73ab8\") " pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.728533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysctl-conf\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.728533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728391    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-kubelet\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.728533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728413    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.728533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728455    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-log-socket\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.728533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728481    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:06.728881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728528    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysconfig\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.728881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728603    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-systemd\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.728881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728690    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovnkube-script-lib\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.728881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728749    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cgmg\" (UniqueName: \"kubernetes.io/projected/fde2ef97-46ba-4e3d-b873-472072d6b408-kube-api-access-5cgmg\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:06.728881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728776    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:06.728881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728830    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-var-lib-kubelet\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.728942    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-run-netns\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729009    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-etc-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729055    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729125    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-env-overrides\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729157    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729238    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-host\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729267    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-tuned\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729293    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ddda861-4189-4019-918a-ee3d1a2e991a-tmp\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-var-lib-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729328    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cvhxf\""
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729347    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-ovn\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729378    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-cni-netd\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnsx5\" (UniqueName: \"kubernetes.io/projected/eb1e549e-185e-4e3f-837e-14530ade3333-kube-api-access-hnsx5\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.729698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729430    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysctl-d\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729466    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-slash\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729509    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-kubernetes\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729584    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-cni-bin\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729650    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovn-node-metrics-cert\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729948 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729704    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-sys-fs\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.729948 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-modprobe-d\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729948 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729763    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-run\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729948 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729786    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-sys\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.729948 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729808    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-systemd-units\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.729948 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.729843    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-node-log\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.730218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.730005    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovnkube-config\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.730218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.730074    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-registration-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.730218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.730117    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c70a299b-1c8a-4402-8c72-881dc3e73ab8-agent-certs\") pod \"konnectivity-agent-zkxfs\" (UID: \"c70a299b-1c8a-4402-8c72-881dc3e73ab8\") " pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.730218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.730154    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-lib-modules\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.730423 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.730224    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.733276 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.733001    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.733392 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.733350    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.734697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.733921    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 16:30:06.734697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.734147    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r2w9c\""
Sep 08 16:30:06.734697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.734254    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.735909 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.735531    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fgdln\""
Sep 08 16:30:06.737533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.737511    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 16:30:06.738145 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.738129    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 16:30:06.738208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.738159    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 16:30:06.760508 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.760482    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:06.782932 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.782879    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qw8dc"
Sep 08 16:30:06.798365 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.798324    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qw8dc"
Sep 08 16:30:06.816694 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.816667    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 16:30:06.830470 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830432    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-etc-selinux\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830499    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830527    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c70a299b-1c8a-4402-8c72-881dc3e73ab8-agent-certs\") pod \"konnectivity-agent-zkxfs\" (UID: \"c70a299b-1c8a-4402-8c72-881dc3e73ab8\") " pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-lib-modules\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830574    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-systemd\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830582    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-etc-selinux\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830599    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-socket-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.830633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830626    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-kubelet\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830652    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8c71dfb-970d-456f-9524-ed93a7904850-dbus\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830678    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysctl-conf\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830720    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-kubelet\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830746    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cnibin\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830779    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830806    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/933cddf1-a897-4907-a4a7-6a1c09f95264-hosts-file\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830861    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-cnibin\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830866    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-socket-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830885    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-multus-certs\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830923    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8c71dfb-970d-456f-9524-ed93a7904850-kubelet-config\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830947    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-systemd\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830953    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-kubelet\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.830954    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysconfig\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831005    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-systemd\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831015    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysconfig\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831042    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovnkube-script-lib\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831074    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831078    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-systemd\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831147    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-lib-modules\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831174    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysctl-conf\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831193    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-cni-bin\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831211    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-var-lib-kubelet\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831334    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-run-netns\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831358    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-etc-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831395    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831468    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-var-lib-kubelet\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831502    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-run-netns\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831504    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831534    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-etc-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831549    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-system-cni-dir\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831593    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-cni-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831634    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-conf-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831666    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-host\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.831940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831712    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ddda861-4189-4019-918a-ee3d1a2e991a-tmp\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831724    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovnkube-script-lib\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831740    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-host\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831768    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-ovn\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-daemon-config\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831745    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831853    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-ovn\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831899    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysctl-d\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.831976    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-slash\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832018    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-sysctl-d\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832023    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c0cad9-8984-4d76-be21-7086d4c6b012-host-slash\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832049    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-slash\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832058    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-955xn\" (UniqueName: \"kubernetes.io/projected/fd226f21-edbd-4fce-ba8a-7b92513e93ed-kube-api-access-955xn\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2df1a785-3dd3-4636-b3ea-c738d46b0e84-serviceca\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832119    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hpt\" (UniqueName: \"kubernetes.io/projected/2df1a785-3dd3-4636-b3ea-c738d46b0e84-kube-api-access-n2hpt\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832145    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e252b5e-1f76-45e8-904f-b4c744adfc64-cni-binary-copy\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832171    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-cni-multus\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-kubernetes\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.832628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832228    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832306    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-kubernetes\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832315    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-sys-fs\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832348    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-run-ovn-kubernetes\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832400    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-socket-dir-parent\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832457    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-sys-fs\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832495    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-hostroot\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832526    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djjrn\" (UniqueName: \"kubernetes.io/projected/5e252b5e-1f76-45e8-904f-b4c744adfc64-kube-api-access-djjrn\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832580    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-run\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832670    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-run\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832704    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-node-log\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832737    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-registration-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832763    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-device-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832843    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-registration-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832880    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-node-log\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832882    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-device-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832918    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thc8j\" (UniqueName: \"kubernetes.io/projected/9ddda861-4189-4019-918a-ee3d1a2e991a-kube-api-access-thc8j\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.833367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832960    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n668w\" (UniqueName: \"kubernetes.io/projected/b4798fd5-9752-48e5-902b-ba3223f7e3f7-kube-api-access-n668w\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.832983    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833006    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/933cddf1-a897-4907-a4a7-6a1c09f95264-tmp-dir\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833054    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm57b\" (UniqueName: \"kubernetes.io/projected/933cddf1-a897-4907-a4a7-6a1c09f95264-kube-api-access-dm57b\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833083    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-system-cni-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.833099    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833109    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c70a299b-1c8a-4402-8c72-881dc3e73ab8-konnectivity-ca\") pod \"konnectivity-agent-zkxfs\" (UID: \"c70a299b-1c8a-4402-8c72-881dc3e73ab8\") " pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833135    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833171    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-log-socket\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833196    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4c0cad9-8984-4d76-be21-7086d4c6b012-iptables-alerter-script\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833222    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.833311    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:07.333270837 +0000 UTC m=+3.037113819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833504    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cgmg\" (UniqueName: \"kubernetes.io/projected/fde2ef97-46ba-4e3d-b873-472072d6b408-kube-api-access-5cgmg\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833534    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-env-overrides\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833578    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-tuned\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833585    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-log-socket\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833601    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-var-lib-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833631    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-cni-netd\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833653    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-run-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833662    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnsx5\" (UniqueName: \"kubernetes.io/projected/eb1e549e-185e-4e3f-837e-14530ade3333-kube-api-access-hnsx5\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833920    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c70a299b-1c8a-4402-8c72-881dc3e73ab8-konnectivity-ca\") pod \"konnectivity-agent-zkxfs\" (UID: \"c70a299b-1c8a-4402-8c72-881dc3e73ab8\") " pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.833988    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw2x6\" (UniqueName: \"kubernetes.io/projected/a4c0cad9-8984-4d76-be21-7086d4c6b012-kube-api-access-zw2x6\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834034    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834046    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-var-lib-openvswitch\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834065    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-etc-kubernetes\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834105    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb1e549e-185e-4e3f-837e-14530ade3333-kubelet-dir\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834105    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-k8s-cni-cncf-io\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834149    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-cni-netd\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834160    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-netns\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-cni-bin\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834233    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovn-node-metrics-cert\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834261    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834320    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2df1a785-3dd3-4636-b3ea-c738d46b0e84-host\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.834933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834325    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-env-overrides\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834349    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-modprobe-d\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834391    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-sys\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834397    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-host-cni-bin\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-systemd-units\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834463    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovnkube-config\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834507    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-modprobe-d\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834552    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b4798fd5-9752-48e5-902b-ba3223f7e3f7-systemd-units\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.834609    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ddda861-4189-4019-918a-ee3d1a2e991a-sys\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.835794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.835078    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovnkube-config\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.836269 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.835961    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ddda861-4189-4019-918a-ee3d1a2e991a-tmp\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.836269 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.835981    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal" event={"ID":"3942b755a80943cc8a080b1a44e287c8","Type":"ContainerStarted","Data":"6dce495aa067c7a5dcf0710f3dc10e9347d8fd535ad850d7ff2e4a3b0b8e3fa1"}
Sep 08 16:30:06.836595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.836551    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c70a299b-1c8a-4402-8c72-881dc3e73ab8-agent-certs\") pod \"konnectivity-agent-zkxfs\" (UID: \"c70a299b-1c8a-4402-8c72-881dc3e73ab8\") " pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:06.837404 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.837380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b4798fd5-9752-48e5-902b-ba3223f7e3f7-ovn-node-metrics-cert\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.837894 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.837861    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal" event={"ID":"8d914bb912e7494f7b37b4c668e9e45d","Type":"ContainerStarted","Data":"8042c3f61491ea516b3cd085d2dcb8dab6ee75fc441b35c4e84c74ce5dcbf09f"}
Sep 08 16:30:06.839117 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.839093    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9ddda861-4189-4019-918a-ee3d1a2e991a-etc-tuned\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.840718 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.840696    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:06.840818 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.840729    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:06.840818 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.840744    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:06.840950 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.840870    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:07.340850246 +0000 UTC m=+3.044693242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:06.843951 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.843926    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cgmg\" (UniqueName: \"kubernetes.io/projected/fde2ef97-46ba-4e3d-b873-472072d6b408-kube-api-access-5cgmg\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:06.854012 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.853981    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnsx5\" (UniqueName: \"kubernetes.io/projected/eb1e549e-185e-4e3f-837e-14530ade3333-kube-api-access-hnsx5\") pod \"aws-ebs-csi-driver-node-z7r5b\" (UID: \"eb1e549e-185e-4e3f-837e-14530ade3333\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:06.859580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.859553    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thc8j\" (UniqueName: \"kubernetes.io/projected/9ddda861-4189-4019-918a-ee3d1a2e991a-kube-api-access-thc8j\") pod \"tuned-c4pc8\" (UID: \"9ddda861-4189-4019-918a-ee3d1a2e991a\") " pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:06.861293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.861265    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n668w\" (UniqueName: \"kubernetes.io/projected/b4798fd5-9752-48e5-902b-ba3223f7e3f7-kube-api-access-n668w\") pod \"ovnkube-node-4qz6l\" (UID: \"b4798fd5-9752-48e5-902b-ba3223f7e3f7\") " pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:06.935307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935248    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.935466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935324    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-kubelet\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8c71dfb-970d-456f-9524-ed93a7904850-dbus\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.935466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935381    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cnibin\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.935466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.935466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/933cddf1-a897-4907-a4a7-6a1c09f95264-hosts-file\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.935645 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935488    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-cnibin\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935645 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935513    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-multus-certs\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935645 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935542    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8c71dfb-970d-456f-9524-ed93a7904850-kubelet-config\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.935645 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935584    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-cni-bin\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935645 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935610    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-system-cni-dir\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.935645 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935626    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-cni-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935649    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-conf-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935674    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-daemon-config\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935692    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c0cad9-8984-4d76-be21-7086d4c6b012-host-slash\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935718    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-955xn\" (UniqueName: \"kubernetes.io/projected/fd226f21-edbd-4fce-ba8a-7b92513e93ed-kube-api-access-955xn\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935734    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2df1a785-3dd3-4636-b3ea-c738d46b0e84-serviceca\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935752    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hpt\" (UniqueName: \"kubernetes.io/projected/2df1a785-3dd3-4636-b3ea-c738d46b0e84-kube-api-access-n2hpt\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935767    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e252b5e-1f76-45e8-904f-b4c744adfc64-cni-binary-copy\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935786    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-cni-multus\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935796    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cni-binary-copy\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.935844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935813    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-socket-dir-parent\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.936294 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935860    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-hostroot\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.936294 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.935887    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djjrn\" (UniqueName: \"kubernetes.io/projected/5e252b5e-1f76-45e8-904f-b4c744adfc64-kube-api-access-djjrn\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.938917 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.938882    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/933cddf1-a897-4907-a4a7-6a1c09f95264-tmp-dir\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.939054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.938961    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm57b\" (UniqueName: \"kubernetes.io/projected/933cddf1-a897-4907-a4a7-6a1c09f95264-kube-api-access-dm57b\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.939054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.938992    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-cni-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939017    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-system-cni-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939076    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4c0cad9-8984-4d76-be21-7086d4c6b012-iptables-alerter-script\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.939229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939087    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-system-cni-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939163    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-kubelet\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939182    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-cnibin\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939241    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cnibin\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.939472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939264    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b8c71dfb-970d-456f-9524-ed93a7904850-kubelet-config\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.939472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939288    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-multus-certs\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939337    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-cni-bin\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939359    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-system-cni-dir\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.939472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939436    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/933cddf1-a897-4907-a4a7-6a1c09f95264-hosts-file\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.939809 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939785    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b8c71dfb-970d-456f-9524-ed93a7904850-dbus\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.939899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939880    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-var-lib-cni-multus\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.939969 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.939943    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2df1a785-3dd3-4636-b3ea-c738d46b0e84-serviceca\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.940313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940287    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a4c0cad9-8984-4d76-be21-7086d4c6b012-iptables-alerter-script\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.940389 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940354    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:06.940442 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940402    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw2x6\" (UniqueName: \"kubernetes.io/projected/a4c0cad9-8984-4d76-be21-7086d4c6b012-kube-api-access-zw2x6\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.940496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940452    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.940704 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.940672    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:06.940704 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940700    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5e252b5e-1f76-45e8-904f-b4c744adfc64-cni-binary-copy\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.940902 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940764    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/933cddf1-a897-4907-a4a7-6a1c09f95264-tmp-dir\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.940902 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940788    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-socket-dir-parent\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.940902 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:06.940771    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:07.4407406 +0000 UTC m=+3.144583589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:06.940902 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940893    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4c0cad9-8984-4d76-be21-7086d4c6b012-host-slash\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940949    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940952    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-conf-dir\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.940435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd226f21-edbd-4fce-ba8a-7b92513e93ed-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941019    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-etc-kubernetes\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-k8s-cni-cncf-io\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941057    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-hostroot\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941084    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-netns\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941099    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-etc-kubernetes\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941122    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941155    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-k8s-cni-cncf-io\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941155    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2df1a785-3dd3-4636-b3ea-c738d46b0e84-host\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941200    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e252b5e-1f76-45e8-904f-b4c744adfc64-host-run-netns\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941252    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2df1a785-3dd3-4636-b3ea-c738d46b0e84-host\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941312    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd226f21-edbd-4fce-ba8a-7b92513e93ed-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.941443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.941430    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5e252b5e-1f76-45e8-904f-b4c744adfc64-multus-daemon-config\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.954098 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.954023    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw2x6\" (UniqueName: \"kubernetes.io/projected/a4c0cad9-8984-4d76-be21-7086d4c6b012-kube-api-access-zw2x6\") pod \"iptables-alerter-vs6c9\" (UID: \"a4c0cad9-8984-4d76-be21-7086d4c6b012\") " pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:06.954242 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.954112    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm57b\" (UniqueName: \"kubernetes.io/projected/933cddf1-a897-4907-a4a7-6a1c09f95264-kube-api-access-dm57b\") pod \"node-resolver-mzbwf\" (UID: \"933cddf1-a897-4907-a4a7-6a1c09f95264\") " pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:06.955947 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.955914    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-955xn\" (UniqueName: \"kubernetes.io/projected/fd226f21-edbd-4fce-ba8a-7b92513e93ed-kube-api-access-955xn\") pod \"multus-additional-cni-plugins-cpclg\" (UID: \"fd226f21-edbd-4fce-ba8a-7b92513e93ed\") " pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:06.956594 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.956569    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djjrn\" (UniqueName: \"kubernetes.io/projected/5e252b5e-1f76-45e8-904f-b4c744adfc64-kube-api-access-djjrn\") pod \"multus-4nnb6\" (UID: \"5e252b5e-1f76-45e8-904f-b4c744adfc64\") " pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:06.957325 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:06.957267    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hpt\" (UniqueName: \"kubernetes.io/projected/2df1a785-3dd3-4636-b3ea-c738d46b0e84-kube-api-access-n2hpt\") pod \"node-ca-htghg\" (UID: \"2df1a785-3dd3-4636-b3ea-c738d46b0e84\") " pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:07.015483 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.015445    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:07.021483 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.021456    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c4pc8"
Sep 08 16:30:07.031642 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.031612    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:07.032793 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.032753    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70a299b_1c8a_4402_8c72_881dc3e73ab8.slice/crio-ff50f44704f979ee1648d7daecb7387eb77f73a6de0e0b52d7eb1095afe8dd4a WatchSource:0}: Error finding container ff50f44704f979ee1648d7daecb7387eb77f73a6de0e0b52d7eb1095afe8dd4a: Status 404 returned error can't find the container with id ff50f44704f979ee1648d7daecb7387eb77f73a6de0e0b52d7eb1095afe8dd4a
Sep 08 16:30:07.033763 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.033739    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ddda861_4189_4019_918a_ee3d1a2e991a.slice/crio-b61dc6bcef313dd18c0422d87771a63caef34b240668cb700a30bb1de0792e64 WatchSource:0}: Error finding container b61dc6bcef313dd18c0422d87771a63caef34b240668cb700a30bb1de0792e64: Status 404 returned error can't find the container with id b61dc6bcef313dd18c0422d87771a63caef34b240668cb700a30bb1de0792e64
Sep 08 16:30:07.035686 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.035667    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b"
Sep 08 16:30:07.042729 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.042706    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4nnb6"
Sep 08 16:30:07.049031 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.049009    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs6c9"
Sep 08 16:30:07.049767 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.049738    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1e549e_185e_4e3f_837e_14530ade3333.slice/crio-3e5fc43a75fcc32ddfe6e5d57f90c66440a357679b2f59a94a708ab58976a034 WatchSource:0}: Error finding container 3e5fc43a75fcc32ddfe6e5d57f90c66440a357679b2f59a94a708ab58976a034: Status 404 returned error can't find the container with id 3e5fc43a75fcc32ddfe6e5d57f90c66440a357679b2f59a94a708ab58976a034
Sep 08 16:30:07.051624 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.051599    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4798fd5_9752_48e5_902b_ba3223f7e3f7.slice/crio-4c7cbb0e656a5fd4dfe4bd7f95e57d8d798dd03f0bf87fa25ac4ac96d05ee92a WatchSource:0}: Error finding container 4c7cbb0e656a5fd4dfe4bd7f95e57d8d798dd03f0bf87fa25ac4ac96d05ee92a: Status 404 returned error can't find the container with id 4c7cbb0e656a5fd4dfe4bd7f95e57d8d798dd03f0bf87fa25ac4ac96d05ee92a
Sep 08 16:30:07.056636 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.056612    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cpclg"
Sep 08 16:30:07.056946 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.056909    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e252b5e_1f76_45e8_904f_b4c744adfc64.slice/crio-f92f5ed90e5e495e4eb4bc699d4bd96be8845f1b800f2dd733a8f29baa892f6f WatchSource:0}: Error finding container f92f5ed90e5e495e4eb4bc699d4bd96be8845f1b800f2dd733a8f29baa892f6f: Status 404 returned error can't find the container with id f92f5ed90e5e495e4eb4bc699d4bd96be8845f1b800f2dd733a8f29baa892f6f
Sep 08 16:30:07.061767 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.061747    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-htghg"
Sep 08 16:30:07.064227 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.064186    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c0cad9_8984_4d76_be21_7086d4c6b012.slice/crio-146b3ec34898998401c1dd92de348ec6c4141bcddacc6e80f3e21432a2bbfe69 WatchSource:0}: Error finding container 146b3ec34898998401c1dd92de348ec6c4141bcddacc6e80f3e21432a2bbfe69: Status 404 returned error can't find the container with id 146b3ec34898998401c1dd92de348ec6c4141bcddacc6e80f3e21432a2bbfe69
Sep 08 16:30:07.068062 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.067461    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mzbwf"
Sep 08 16:30:07.080765 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:07.080477    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933cddf1_a897_4907_a4a7_6a1c09f95264.slice/crio-a9f6023abc1a524dcfd8ff8dbbf89dcf723d79d9697e71d149bef8717db166d4 WatchSource:0}: Error finding container a9f6023abc1a524dcfd8ff8dbbf89dcf723d79d9697e71d149bef8717db166d4: Status 404 returned error can't find the container with id a9f6023abc1a524dcfd8ff8dbbf89dcf723d79d9697e71d149bef8717db166d4
Sep 08 16:30:07.343454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.343359    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:07.343454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.343429    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:07.343732 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.343492    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:07.343732 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.343520    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:07.343732 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.343534    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:07.343732 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.343538    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:07.343732 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.343595    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:08.343576088 +0000 UTC m=+4.047419086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:07.343732 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.343614    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:08.343603946 +0000 UTC m=+4.047446928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:07.444340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.444286    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:07.444505 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.444472    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:07.444587 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:07.444550    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:08.444528927 +0000 UTC m=+4.148371931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:07.801177 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.801117    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 16:25:07 +0000 UTC" deadline="2028-06-22 19:58:46.159275 +0000 UTC"
Sep 08 16:30:07.801177 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.801172    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15675h28m38.358108044s"
Sep 08 16:30:07.843609 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.843569    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs6c9" event={"ID":"a4c0cad9-8984-4d76-be21-7086d4c6b012","Type":"ContainerStarted","Data":"146b3ec34898998401c1dd92de348ec6c4141bcddacc6e80f3e21432a2bbfe69"}
Sep 08 16:30:07.847652 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.847624    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b" event={"ID":"eb1e549e-185e-4e3f-837e-14530ade3333","Type":"ContainerStarted","Data":"3e5fc43a75fcc32ddfe6e5d57f90c66440a357679b2f59a94a708ab58976a034"}
Sep 08 16:30:07.849887 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.849860    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c4pc8" event={"ID":"9ddda861-4189-4019-918a-ee3d1a2e991a","Type":"ContainerStarted","Data":"b61dc6bcef313dd18c0422d87771a63caef34b240668cb700a30bb1de0792e64"}
Sep 08 16:30:07.851491 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.851468    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zkxfs" event={"ID":"c70a299b-1c8a-4402-8c72-881dc3e73ab8","Type":"ContainerStarted","Data":"ff50f44704f979ee1648d7daecb7387eb77f73a6de0e0b52d7eb1095afe8dd4a"}
Sep 08 16:30:07.853105 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.853070    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mzbwf" event={"ID":"933cddf1-a897-4907-a4a7-6a1c09f95264","Type":"ContainerStarted","Data":"a9f6023abc1a524dcfd8ff8dbbf89dcf723d79d9697e71d149bef8717db166d4"}
Sep 08 16:30:07.854618 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.854559    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerStarted","Data":"665d6e64ecdf90899caaa9ed55c42bcc23643442df09ab7a2c904ef31452ce3a"}
Sep 08 16:30:07.856140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.856115    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4nnb6" event={"ID":"5e252b5e-1f76-45e8-904f-b4c744adfc64","Type":"ContainerStarted","Data":"f92f5ed90e5e495e4eb4bc699d4bd96be8845f1b800f2dd733a8f29baa892f6f"}
Sep 08 16:30:07.857593 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.857564    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"4c7cbb0e656a5fd4dfe4bd7f95e57d8d798dd03f0bf87fa25ac4ac96d05ee92a"}
Sep 08 16:30:07.860409 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:07.860364    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htghg" event={"ID":"2df1a785-3dd3-4636-b3ea-c738d46b0e84","Type":"ContainerStarted","Data":"181c5fca56d1c8be633751f03599242dc8fa616147917dbb7a6701ce34162a69"}
Sep 08 16:30:08.352800 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.352760    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:08.352968 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.352856    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:08.353035 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.353012    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:08.353035 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.353032    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:08.353134 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.353047    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:08.353134 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.353112    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:10.353090483 +0000 UTC m=+6.056933468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:08.353715 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.353664    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:08.353821 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.353742    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:10.35372753 +0000 UTC m=+6.057570509 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:08.454462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.453601    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:08.454462 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.454022    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:08.454462 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.454095    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:10.454073847 +0000 UTC m=+6.157916848 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:08.801855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.801766    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 16:25:07 +0000 UTC" deadline="2028-06-11 15:09:09.385637528 +0000 UTC"
Sep 08 16:30:08.801855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.801822    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15406h39m0.583821099s"
Sep 08 16:30:08.829399 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.829365    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:08.829577 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.829505    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:08.830134 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.830105    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:08.830253 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.830236    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:08.830311 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.830110    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:08.830423 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:08.830380    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:08.868332 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:08.868289    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal" event={"ID":"8d914bb912e7494f7b37b4c668e9e45d","Type":"ContainerStarted","Data":"01904e3791216309efa04748a504292ca3ca5a0c1eca3cbe3ff333af70a1e800"}
Sep 08 16:30:09.891073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:09.890088    2547 generic.go:356] "Generic (PLEG): container finished" podID="8d914bb912e7494f7b37b4c668e9e45d" containerID="01904e3791216309efa04748a504292ca3ca5a0c1eca3cbe3ff333af70a1e800" exitCode=0
Sep 08 16:30:09.891073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:09.890157    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal" event={"ID":"8d914bb912e7494f7b37b4c668e9e45d","Type":"ContainerDied","Data":"01904e3791216309efa04748a504292ca3ca5a0c1eca3cbe3ff333af70a1e800"}
Sep 08 16:30:10.374100 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:10.374011    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:10.374100 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:10.374085    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:10.374320 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.374238    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:10.374320 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.374303    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:14.374281956 +0000 UTC m=+10.078124939 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:10.374758 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.374738    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:10.374841 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.374766    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:10.374841 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.374779    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:10.374841 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.374826    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:14.374809355 +0000 UTC m=+10.078652344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:10.475260 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:10.475220    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:10.475457 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.475376    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:10.475457 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.475435    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:14.475417045 +0000 UTC m=+10.179260041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:10.829559 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:10.828974    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:10.829559 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:10.828985    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:10.829559 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:10.829137    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:10.829559 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.829137    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:10.829559 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.829236    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:10.829559 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:10.829317    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:12.828756 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:12.828720    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:12.829258 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:12.828847    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:12.829258 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:12.828921    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:12.829258 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:12.829027    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:12.829258 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:12.829072    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:12.829258 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:12.829138    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:14.408104 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:14.408014    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:14.408104 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:14.408085    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:14.408608 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.408217    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:14.408608 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.408226    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:14.408608 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.408251    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:14.408608 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.408268    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:14.408608 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.408309    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:22.408288954 +0000 UTC m=+18.112131946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:14.408608 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.408332    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:22.408320154 +0000 UTC m=+18.112163141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:14.509216 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:14.509173    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:14.509409 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.509344    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:14.509473 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.509440    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:22.509410895 +0000 UTC m=+18.213253886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:14.828370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:14.827051    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:14.828370 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.827160    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:14.828370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:14.827533    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:14.828370 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.827632    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:14.828370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:14.827694    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:14.828370 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:14.827746    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:16.829958 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:16.829240    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:16.829958 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:16.829391    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:16.829958 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:16.829705    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:16.829958 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:16.829809    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:16.829958 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:16.829853    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:16.829958 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:16.829904    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:18.827301 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:18.827218    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:18.827736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:18.827217    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:18.827736 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:18.827350    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:18.827736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:18.827229    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:18.827736 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:18.827442    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:18.827736 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:18.827474    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:20.826829 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:20.826791    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:20.827291 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:20.826792    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:20.827291 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:20.826921    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:20.827291 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:20.826798    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:20.827291 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:20.827005    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:20.827291 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:20.827083    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:22.476818 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:22.476766    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:22.477347 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:22.476840    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:22.477347 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.477232    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:22.477347 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.477260    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:22.477347 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.477288    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:22.477347 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.477315    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:22.477595 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.477365    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:38.47733852 +0000 UTC m=+34.181181502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:22.477595 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.477390    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:38.477373941 +0000 UTC m=+34.181216941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:22.577538 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:22.577493    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:22.577724 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.577672    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:22.577810 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.577749    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:38.577728372 +0000 UTC m=+34.281571367 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:22.827111 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:22.827028    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:22.827275 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:22.827028    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:22.827275 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.827154    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:22.827275 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:22.827046    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:22.827275 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.827234    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:22.827484 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:22.827315    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:24.827544 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:24.827503    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:24.827994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:24.827608    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:24.827994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:24.827638    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:24.827994 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:24.827720    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:24.828180 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:24.828098    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:24.828225 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:24.828181    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:26.827243 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.826987    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:26.827922 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.826992    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:26.827922 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:26.827349    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:26.827922 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.827038    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:26.827922 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:26.827443    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:26.827922 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:26.827469    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:26.927247 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.927165    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal" event={"ID":"3942b755a80943cc8a080b1a44e287c8","Type":"ContainerStarted","Data":"af2f10e2aa90d8b2c40c9c4a36758270ee175bc838f9461f7b440b8baa4a8542"}
Sep 08 16:30:26.929071 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.929045    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal" event={"ID":"8d914bb912e7494f7b37b4c668e9e45d","Type":"ContainerStarted","Data":"c675b34784f2b103b384386eae9ae3d1676dd0d3b1abb3fa98579695813ec261"}
Sep 08 16:30:26.930416 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.930396    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-htghg" event={"ID":"2df1a785-3dd3-4636-b3ea-c738d46b0e84","Type":"ContainerStarted","Data":"0862d1f5285be706089da52a96f9521f8ef09322ad06b0c0a17571343cc56e61"}
Sep 08 16:30:26.931821 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.931801    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b" event={"ID":"eb1e549e-185e-4e3f-837e-14530ade3333","Type":"ContainerStarted","Data":"d0fe30f6de4023f701498a108b9b21b6fc1e316a95fbe11e2c089818dc106032"}
Sep 08 16:30:26.933126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.933108    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c4pc8" event={"ID":"9ddda861-4189-4019-918a-ee3d1a2e991a","Type":"ContainerStarted","Data":"90e692c978b6f930cd0922fe5866f448f77272f36438b6e08dc7701d645cb966"}
Sep 08 16:30:26.934339 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.934319    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zkxfs" event={"ID":"c70a299b-1c8a-4402-8c72-881dc3e73ab8","Type":"ContainerStarted","Data":"0bedc000f111551c5df980029c042b7a8a9021acba093b007601a4552724054e"}
Sep 08 16:30:26.935514 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.935493    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mzbwf" event={"ID":"933cddf1-a897-4907-a4a7-6a1c09f95264","Type":"ContainerStarted","Data":"178fb3720123fa507b16ae989ebd98994f440293ab8410721d551cab775c78ac"}
Sep 08 16:30:26.936903 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.936880    2547 generic.go:356] "Generic (PLEG): container finished" podID="fd226f21-edbd-4fce-ba8a-7b92513e93ed" containerID="c1bdd52feb6002a602433ad6299dc38b676f716eb3b2e01e6ba394bfb125d882" exitCode=0
Sep 08 16:30:26.937003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.936955    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerDied","Data":"c1bdd52feb6002a602433ad6299dc38b676f716eb3b2e01e6ba394bfb125d882"}
Sep 08 16:30:26.938485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.938467    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4nnb6" event={"ID":"5e252b5e-1f76-45e8-904f-b4c744adfc64","Type":"ContainerStarted","Data":"09b1e6e44f743706f850b8e7a70095961992470ae273c7408386f88f406ecf2f"}
Sep 08 16:30:26.941594 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.941577    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"0f2145dc58fd96169cf9f10fd9b245d709e1591d7f2848954f34d0ed846d118b"}
Sep 08 16:30:26.941664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.941628    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"d87028d3c419ffb6211bbda6286db2dc05c0bfb7c79c61c60e846bfb40c20bf5"}
Sep 08 16:30:26.941664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.941657    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"d924f53a2d51ac48dc1ad87ddbffa7c10e71a009988266468cef253903f60318"}
Sep 08 16:30:26.941734 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.941684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"45965811fe7dfea49348e5c0df205d71db275de91c677af7e679df4fff504b0b"}
Sep 08 16:30:26.941734 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.941711    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"16a5f42af764fa67630c6f0ae08285c5fc228f6e3a2ec4e71720d9b751a0ee93"}
Sep 08 16:30:26.941815 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.941738    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"35c7980c0754bb2ce0fb54be185e2919220bbeb80596704d4d9ba7f0662b7290"}
Sep 08 16:30:26.962992 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.962948    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-146.ec2.internal" podStartSLOduration=20.962936373 podStartE2EDuration="20.962936373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:26.942883503 +0000 UTC m=+22.646726503" watchObservedRunningTime="2026-09-08 16:30:26.962936373 +0000 UTC m=+22.666779427"
Sep 08 16:30:26.963186 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:26.963166    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4nnb6" podStartSLOduration=2.656491233 podStartE2EDuration="21.96316151s" totalImagesPullingTime="19.306670277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:26.96307197 +0000 UTC m=+22.666914950" watchObservedRunningTime="2026-09-08 16:30:26.96316151 +0000 UTC m=+22.667004510"
Sep 08 16:30:27.012174 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.012125    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-htghg" podStartSLOduration=1.95716155 podStartE2EDuration="21.012104865s" totalImagesPullingTime="19.054943315s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:26.997433325 +0000 UTC m=+22.701276324" watchObservedRunningTime="2026-09-08 16:30:27.012104865 +0000 UTC m=+22.715947868"
Sep 08 16:30:27.012440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.012418    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zkxfs" podStartSLOduration=3.132718151 podStartE2EDuration="22.012411593s" totalImagesPullingTime="18.879693442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:27.012171441 +0000 UTC m=+22.716014441" watchObservedRunningTime="2026-09-08 16:30:27.012411593 +0000 UTC m=+22.716254607"
Sep 08 16:30:27.036026 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.035985    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c4pc8" podStartSLOduration=2.894480889 podStartE2EDuration="22.035970953s" totalImagesPullingTime="19.141490064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:27.035652377 +0000 UTC m=+22.739495378" watchObservedRunningTime="2026-09-08 16:30:27.035970953 +0000 UTC m=+22.739813995"
Sep 08 16:30:27.058139 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.058095    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mzbwf" podStartSLOduration=1.986153016 podStartE2EDuration="21.058081737s" totalImagesPullingTime="19.071928721s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:27.057619189 +0000 UTC m=+22.761462188" watchObservedRunningTime="2026-09-08 16:30:27.058081737 +0000 UTC m=+22.761924736"
Sep 08 16:30:27.079231 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.079190    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-146.ec2.internal" podStartSLOduration=21.079174117 podStartE2EDuration="21.079174117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:27.079040714 +0000 UTC m=+22.782883714" watchObservedRunningTime="2026-09-08 16:30:27.079174117 +0000 UTC m=+22.783017117"
Sep 08 16:30:27.218827 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.218796    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:27.945617 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.945520    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs6c9" event={"ID":"a4c0cad9-8984-4d76-be21-7086d4c6b012","Type":"ContainerStarted","Data":"193acdb8367daaaef0538c4e60e82ab2baa1ad79659f6ec0311462348ec174f9"}
Sep 08 16:30:27.961268 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:27.961217    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vs6c9" podStartSLOduration=3.8483485010000003 podStartE2EDuration="22.961203031s" totalImagesPullingTime="19.11285453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:27.961124244 +0000 UTC m=+23.664967243" watchObservedRunningTime="2026-09-08 16:30:27.961203031 +0000 UTC m=+23.665046028"
Sep 08 16:30:28.387129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.387110    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 16:30:28.793240 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.793120    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T16:30:28.387126345Z","UUID":"57257cb3-bff1-4af2-903a-0d4461941b6f","Handler":null,"Name":"","Endpoint":""}
Sep 08 16:30:28.795157 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.795108    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 16:30:28.795307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.795171    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 16:30:28.826308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.826279    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:28.826493 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:28.826420    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:28.826615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.826599    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:28.826712 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.826671    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:28.826831 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:28.826810    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:28.826911 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:28.826885    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:28.950287 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.950255    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b" event={"ID":"eb1e549e-185e-4e3f-837e-14530ade3333","Type":"ContainerStarted","Data":"ca489f22e91a7d776895e4523151b3c9a72c1eb7ee751d75eff0fe80f0ce3560"}
Sep 08 16:30:28.954273 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:28.954244    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"5fee9b20ccdb30cadc5746917913f0788db59d8c2db027a884e8294037243b57"}
Sep 08 16:30:29.959468 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:29.959426    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b" event={"ID":"eb1e549e-185e-4e3f-837e-14530ade3333","Type":"ContainerStarted","Data":"4091cff9383dc08c3444ba2ca9023fba17f9fc8cb46e41adb02d13c33f2888db"}
Sep 08 16:30:29.976879 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:29.976832    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-z7r5b" podStartSLOduration=2.704302255 podStartE2EDuration="24.976812968s" totalImagesPullingTime="22.272510713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:29.9766363 +0000 UTC m=+25.680479291" watchObservedRunningTime="2026-09-08 16:30:29.976812968 +0000 UTC m=+25.680655965"
Sep 08 16:30:30.826769 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:30.826725    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:30.826958 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:30.826862    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:30.826958 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:30.826891    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:30.826958 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:30.826878    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:30.827100 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:30.826983    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:30.827100 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:30.827069    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:31.878637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:31.878425    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:31.879083 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:31.879061    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:31.964758 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:31.964731    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zkxfs"
Sep 08 16:30:32.826983 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.826949    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:32.827133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.826949    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:32.827133 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:32.827081    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:32.827133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.826953    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:32.827289 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:32.827177    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:32.827289 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:32.827213    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:32.971591 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.971556    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" event={"ID":"b4798fd5-9752-48e5-902b-ba3223f7e3f7","Type":"ContainerStarted","Data":"55be80ae37ce320b64bf1cb63414cde9679860d578562fcdca9170504e379458"}
Sep 08 16:30:32.972514 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.971883    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:32.972514 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.971936    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:32.991257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:32.991235    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:33.035799 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:33.035738    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l" podStartSLOduration=8.910633862 podStartE2EDuration="28.035722109s" totalImagesPullingTime="19.125088247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:33.035268592 +0000 UTC m=+28.739111591" watchObservedRunningTime="2026-09-08 16:30:33.035722109 +0000 UTC m=+28.739565109"
Sep 08 16:30:33.977662 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:33.977398    2547 generic.go:356] "Generic (PLEG): container finished" podID="fd226f21-edbd-4fce-ba8a-7b92513e93ed" containerID="76bffad1a1e0da65e12c295efad812887c3908faa5db99fe6773e0bab1e789dd" exitCode=0
Sep 08 16:30:33.978141 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:33.977494    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerDied","Data":"76bffad1a1e0da65e12c295efad812887c3908faa5db99fe6773e0bab1e789dd"}
Sep 08 16:30:33.978857 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:33.978454    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:34.007393 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.007359    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:30:34.697255 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.697227    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qkf2f"]
Sep 08 16:30:34.697506 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.697333    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:34.697506 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:34.697439    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:34.699246 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.699220    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cswl9"]
Sep 08 16:30:34.699380 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.699327    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:34.699472 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:34.699425    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:34.704201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.704171    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ls2d6"]
Sep 08 16:30:34.704339 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:34.704271    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:34.704402 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:34.704345    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:35.827208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:35.827182    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:35.827572 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:35.827281    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:35.985648 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:35.985610    2547 generic.go:356] "Generic (PLEG): container finished" podID="fd226f21-edbd-4fce-ba8a-7b92513e93ed" containerID="ad3f27dd8dae2bc2be354d494fb4d68ad727fa1f7681436f902d0286f7f107ab" exitCode=0
Sep 08 16:30:35.985843 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:35.985689    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerDied","Data":"ad3f27dd8dae2bc2be354d494fb4d68ad727fa1f7681436f902d0286f7f107ab"}
Sep 08 16:30:36.826470 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:36.826403    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:36.826664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:36.826477    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:36.826664 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:36.826587    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:36.826812 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:36.826723    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:37.826926 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:37.826885    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:37.827312 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:37.826992    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:37.992277 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:37.992194    2547 generic.go:356] "Generic (PLEG): container finished" podID="fd226f21-edbd-4fce-ba8a-7b92513e93ed" containerID="c7a346dfcaf7cb24a6952fe0d98074f4de3a09897a32fbf0bad6acbd71ed0068" exitCode=0
Sep 08 16:30:37.992277 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:37.992248    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerDied","Data":"c7a346dfcaf7cb24a6952fe0d98074f4de3a09897a32fbf0bad6acbd71ed0068"}
Sep 08 16:30:38.497823 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:38.497775    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:38.497997 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:38.497838    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:38.497997 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.497954    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:38.497997 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.497977    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:38.498122 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.498006    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:38.498122 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.498015    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs podName:fde2ef97-46ba-4e3d-b873-472072d6b408 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:10.498000269 +0000 UTC m=+66.201843248 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs") pod "network-metrics-daemon-cswl9" (UID: "fde2ef97-46ba-4e3d-b873-472072d6b408") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:38.498122 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.498020    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fnztr for pod openshift-network-diagnostics/network-check-target-ls2d6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:38.498122 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.498066    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr podName:e8caee6c-1a8f-43cf-a9cd-e064a236ee16 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:10.498053602 +0000 UTC m=+66.201896584 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fnztr" (UniqueName: "kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr") pod "network-check-target-ls2d6" (UID: "e8caee6c-1a8f-43cf-a9cd-e064a236ee16") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:38.599066 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:38.599020    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:38.599218 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.599158    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:38.599266 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.599222    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret podName:b8c71dfb-970d-456f-9524-ed93a7904850 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:10.599207763 +0000 UTC m=+66.303050742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret") pod "global-pull-secret-syncer-qkf2f" (UID: "b8c71dfb-970d-456f-9524-ed93a7904850") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:38.826897 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:38.826809    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:38.827133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:38.826814    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:38.827133 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.826939    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cswl9" podUID="fde2ef97-46ba-4e3d-b873-472072d6b408"
Sep 08 16:30:38.827133 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:38.827011    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ls2d6" podUID="e8caee6c-1a8f-43cf-a9cd-e064a236ee16"
Sep 08 16:30:39.826873 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:39.826835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:39.827067 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:39.826966    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qkf2f" podUID="b8c71dfb-970d-456f-9524-ed93a7904850"
Sep 08 16:30:40.082487 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.082408    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-146.ec2.internal" event="NodeReady"
Sep 08 16:30:40.082942 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.082571    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 16:30:40.120482 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.120447    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d475cd58f-fzv6w"]
Sep 08 16:30:40.123557 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.123536    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.127855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.127475    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 16:30:40.127855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.127545    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 16:30:40.127855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.127475    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x6c7g\""
Sep 08 16:30:40.127855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.127803    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 16:30:40.137073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.137050    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 16:30:40.143244 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.143163    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d475cd58f-fzv6w"]
Sep 08 16:30:40.149406 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.149381    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"]
Sep 08 16:30:40.152379 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.152357    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tfrmw"]
Sep 08 16:30:40.152507 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.152481    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.155195 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.155174    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-n5dsv"]
Sep 08 16:30:40.155303 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.155285    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.156300 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.156282    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 16:30:40.157494 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.157464    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g254h\""
Sep 08 16:30:40.157613 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.157504    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 16:30:40.157725 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.157712    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.157846 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.157766    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-j2tw5\""
Sep 08 16:30:40.157959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.157940    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.158061 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.157987    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 08 16:30:40.158061 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.158045    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 08 16:30:40.158341 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.158323    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-hm59v"]
Sep 08 16:30:40.158447 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.158432    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.160723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.160504    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 16:30:40.160723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.160548    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 16:30:40.160723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.160601    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.160723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.160507    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.160934 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.160917    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lh5fv\""
Sep 08 16:30:40.161443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.161427    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"]
Sep 08 16:30:40.161878 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.161540    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.164559 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.164524    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"]
Sep 08 16:30:40.165388 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.165328    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.166020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.165997    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 16:30:40.170810 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.170707    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 08 16:30:40.172027 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.171948    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.172643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.172269    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.172643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.172504    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 08 16:30:40.172643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.172520    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 16:30:40.172643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.172545    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7tlbk\""
Sep 08 16:30:40.172889 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.172853    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-wd5rr\""
Sep 08 16:30:40.172983 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.172941    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.173188 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.173158    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.173644 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.173326    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"]
Sep 08 16:30:40.174358 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.174342    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"
Sep 08 16:30:40.174475 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.174459    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 16:30:40.176264 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.176247    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b24bq"]
Sep 08 16:30:40.177736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.176376    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.177968 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.177864    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 08 16:30:40.181810 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.180672    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sp9zw\""
Sep 08 16:30:40.181810 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.181682    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jpmpb\""
Sep 08 16:30:40.184819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.183410    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.184819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.183646    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.184819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.183920    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.184819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.183939    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 16:30:40.184819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.184234    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bb6f6fcf8-cxp7q"]
Sep 08 16:30:40.184819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.184467    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.185530 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.185269    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.188537 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.188505    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 16:30:40.189312 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.189293    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zsf6\""
Sep 08 16:30:40.189885 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.189867    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 16:30:40.190225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.190210    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"]
Sep 08 16:30:40.190343 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.190326    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.193322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.193304    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dgxkx"]
Sep 08 16:30:40.193422 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.193394    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 16:30:40.193749 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.193734    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.194555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.194426    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.194620 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.194575    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 16:30:40.194688 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.194654    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 16:30:40.194937 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.194921    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 16:30:40.195113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.195091    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.195192 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.195174    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ntnws\""
Sep 08 16:30:40.196533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196514    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5jw2d\""
Sep 08 16:30:40.196646 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196532    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.196768 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196751    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 16:30:40.196897 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196880    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"]
Sep 08 16:30:40.196959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196896    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.196959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196914    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"]
Sep 08 16:30:40.196959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196938    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-n5dsv"]
Sep 08 16:30:40.196959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196957    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tfrmw"]
Sep 08 16:30:40.197155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.196980    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-crw2t"]
Sep 08 16:30:40.197155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.197002    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.199459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.199442    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 16:30:40.199554 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.199463    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.199554 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.199480    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.199554 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.199528    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 16:30:40.199884 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.199870    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sqr8x\""
Sep 08 16:30:40.200681 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200661    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"]
Sep 08 16:30:40.200754 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200711    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-hm59v"]
Sep 08 16:30:40.200754 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200744    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bb6f6fcf8-cxp7q"]
Sep 08 16:30:40.200875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200765    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b24bq"]
Sep 08 16:30:40.200875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200769    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t"
Sep 08 16:30:40.200875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200810    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"]
Sep 08 16:30:40.200875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200834    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgxkx"]
Sep 08 16:30:40.200875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200857    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"]
Sep 08 16:30:40.201108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.200882    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-crw2t"]
Sep 08 16:30:40.203544 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.203528    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 16:30:40.204061 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.204041    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-28fd5\""
Sep 08 16:30:40.205931 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.205915    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 16:30:40.212355 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212337    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-certificates\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212446 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212370    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212490 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212451    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-trusted-ca\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212490 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212472    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-bound-sa-token\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212492    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4f96a09-2c50-452e-acfb-2b9a39825902-ca-trust-extracted\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212507    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-installation-pull-secrets\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212542    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-image-registry-private-configuration\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.212688 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.212610    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zdgq\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-kube-api-access-6zdgq\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.313076 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.313271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313100    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.313271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313118    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-trusted-ca\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.313271 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.313212    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:30:40.313271 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.313231    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d475cd58f-fzv6w: secret "image-registry-tls" not found
Sep 08 16:30:40.313271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313229    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-tmp\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.313271 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313261    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlc5s\" (UniqueName: \"kubernetes.io/projected/81b11609-f905-4439-8ca5-1d67e72cbf45-kube-api-access-wlc5s\") pod \"network-check-source-685456655f-crw2t\" (UID: \"81b11609-f905-4439-8ca5-1d67e72cbf45\") " pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.313293    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls podName:d4f96a09-2c50-452e-acfb-2b9a39825902 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.813274029 +0000 UTC m=+36.517117011 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls") pod "image-registry-5d475cd58f-fzv6w" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902") : secret "image-registry-tls" not found
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313315    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-bound-sa-token\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313348    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jftqt\" (UniqueName: \"kubernetes.io/projected/37b10fba-cd73-4823-a265-170d76851a3f-kube-api-access-jftqt\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313378    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65xct\" (UniqueName: \"kubernetes.io/projected/272ce978-010b-40c1-bfa8-6e273be82289-kube-api-access-65xct\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313411    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4f96a09-2c50-452e-acfb-2b9a39825902-ca-trust-extracted\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313440    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-installation-pull-secrets\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313465    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3339a813-1197-4748-b594-af4a7bbfdf87-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313491    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-serving-cert\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313517    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-stats-auth\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313544    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.313581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313572    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f3a578-c2f9-424c-82ec-51cf40f8450b-serving-cert\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313594    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr4mj\" (UniqueName: \"kubernetes.io/projected/f0f3a578-c2f9-424c-82ec-51cf40f8450b-kube-api-access-sr4mj\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313618    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b10fba-cd73-4823-a265-170d76851a3f-tmp-dir\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313647    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313674    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0f3a578-c2f9-424c-82ec-51cf40f8450b-config\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/736abb7e-7095-4c23-b845-0d1de077de57-trusted-ca\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313734    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313757    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmqjf\" (UniqueName: \"kubernetes.io/projected/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-kube-api-access-rmqjf\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aace608b-8d23-4025-8571-bccbfcd09df0-nginx-conf\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313837    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/543034bc-8c58-4864-a980-69b199df8d54-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313888    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xbdj\" (UniqueName: \"kubernetes.io/projected/736abb7e-7095-4c23-b845-0d1de077de57-kube-api-access-5xbdj\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313926    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-snapshots\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313950    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3-cert\") pod \"ingress-canary-dgxkx\" (UID: \"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3\") " pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.313978    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65m8n\" (UniqueName: \"kubernetes.io/projected/3339a813-1197-4748-b594-af4a7bbfdf87-kube-api-access-65m8n\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314036    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-trusted-ca\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.314074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314037    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314082    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3339a813-1197-4748-b594-af4a7bbfdf87-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314108    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314128    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xszwg\" (UniqueName: \"kubernetes.io/projected/f2e3ee59-cc2b-493f-a3af-71c39a1ac74d-kube-api-access-xszwg\") pod \"volume-data-source-validator-695c895bd6-s44v8\" (UID: \"f2e3ee59-cc2b-493f-a3af-71c39a1ac74d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314143    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736abb7e-7095-4c23-b845-0d1de077de57-config\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314158    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736abb7e-7095-4c23-b845-0d1de077de57-serving-cert\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314181    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314218    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fltxx\" (UniqueName: \"kubernetes.io/projected/2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3-kube-api-access-fltxx\") pod \"ingress-canary-dgxkx\" (UID: \"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3\") " pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314236    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx56x\" (UniqueName: \"kubernetes.io/projected/7e32abf4-3a35-4ea2-a571-731885501900-kube-api-access-cx56x\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314253    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4f96a09-2c50-452e-acfb-2b9a39825902-ca-trust-extracted\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314273    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37b10fba-cd73-4823-a265-170d76851a3f-config-volume\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314313    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-image-registry-private-configuration\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314334    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314354    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zdgq\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-kube-api-access-6zdgq\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314369    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-default-certificate\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.314697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314412    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-certificates\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.315201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314523    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfxw\" (UniqueName: \"kubernetes.io/projected/543034bc-8c58-4864-a980-69b199df8d54-kube-api-access-rmfxw\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.315201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.314839    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-certificates\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.317636 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.317615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-image-registry-private-configuration\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.317733 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.317671    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-installation-pull-secrets\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.324634 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.324611    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-bound-sa-token\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.324727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.324711    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zdgq\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-kube-api-access-6zdgq\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.415282 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415182    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xszwg\" (UniqueName: \"kubernetes.io/projected/f2e3ee59-cc2b-493f-a3af-71c39a1ac74d-kube-api-access-xszwg\") pod \"volume-data-source-validator-695c895bd6-s44v8\" (UID: \"f2e3ee59-cc2b-493f-a3af-71c39a1ac74d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"
Sep 08 16:30:40.415282 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736abb7e-7095-4c23-b845-0d1de077de57-config\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.415282 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415266    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736abb7e-7095-4c23-b845-0d1de077de57-serving-cert\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415325    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fltxx\" (UniqueName: \"kubernetes.io/projected/2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3-kube-api-access-fltxx\") pod \"ingress-canary-dgxkx\" (UID: \"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3\") " pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415354    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx56x\" (UniqueName: \"kubernetes.io/projected/7e32abf4-3a35-4ea2-a571-731885501900-kube-api-access-cx56x\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415379    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37b10fba-cd73-4823-a265-170d76851a3f-config-volume\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415436    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-default-certificate\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.415520 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.415467    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:40.415912 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.415556    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls podName:543034bc-8c58-4864-a980-69b199df8d54 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.915535647 +0000 UTC m=+36.619378639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-zljt7" (UID: "543034bc-8c58-4864-a980-69b199df8d54") : secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:40.415912 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.415655    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 16:30:40.415912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415469    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfxw\" (UniqueName: \"kubernetes.io/projected/543034bc-8c58-4864-a980-69b199df8d54-kube-api-access-rmfxw\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.415912 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.415758    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.915741984 +0000 UTC m=+36.619584965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : secret "router-metrics-certs-default" not found
Sep 08 16:30:40.415912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415881    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415916    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-tmp\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415945    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlc5s\" (UniqueName: \"kubernetes.io/projected/81b11609-f905-4439-8ca5-1d67e72cbf45-kube-api-access-wlc5s\") pod \"network-check-source-685456655f-crw2t\" (UID: \"81b11609-f905-4439-8ca5-1d67e72cbf45\") " pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415973    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jftqt\" (UniqueName: \"kubernetes.io/projected/37b10fba-cd73-4823-a265-170d76851a3f-kube-api-access-jftqt\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.415999    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65xct\" (UniqueName: \"kubernetes.io/projected/272ce978-010b-40c1-bfa8-6e273be82289-kube-api-access-65xct\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.416024    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416059    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37b10fba-cd73-4823-a265-170d76851a3f-config-volume\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.416073    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls podName:7e32abf4-3a35-4ea2-a571-731885501900 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.916060033 +0000 UTC m=+36.619903025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m9pv8" (UID: "7e32abf4-3a35-4ea2-a571-731885501900") : secret "samples-operator-tls" not found
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416028    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3339a813-1197-4748-b594-af4a7bbfdf87-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-serving-cert\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416131    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-stats-auth\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416148    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.416162 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416163    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f3a578-c2f9-424c-82ec-51cf40f8450b-serving-cert\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416180    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr4mj\" (UniqueName: \"kubernetes.io/projected/f0f3a578-c2f9-424c-82ec-51cf40f8450b-kube-api-access-sr4mj\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416197    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b10fba-cd73-4823-a265-170d76851a3f-tmp-dir\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416221    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416243    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0f3a578-c2f9-424c-82ec-51cf40f8450b-config\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416257    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/736abb7e-7095-4c23-b845-0d1de077de57-trusted-ca\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416286    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416305    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmqjf\" (UniqueName: \"kubernetes.io/projected/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-kube-api-access-rmqjf\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416322    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aace608b-8d23-4025-8571-bccbfcd09df0-nginx-conf\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416339    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/543034bc-8c58-4864-a980-69b199df8d54-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416361    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xbdj\" (UniqueName: \"kubernetes.io/projected/736abb7e-7095-4c23-b845-0d1de077de57-kube-api-access-5xbdj\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416391    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-snapshots\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416409    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3-cert\") pod \"ingress-canary-dgxkx\" (UID: \"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3\") " pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416426    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65m8n\" (UniqueName: \"kubernetes.io/projected/3339a813-1197-4748-b594-af4a7bbfdf87-kube-api-access-65m8n\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416451    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416525    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3339a813-1197-4748-b594-af4a7bbfdf87-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.416925 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416554    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/736abb7e-7095-4c23-b845-0d1de077de57-config\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.416722    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.916707682 +0000 UTC m=+36.620550683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : configmap references non-existent config key: service-ca.crt
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.416817    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-tmp\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.416909    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.416963    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls podName:37b10fba-cd73-4823-a265-170d76851a3f nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.916947862 +0000 UTC m=+36.620790840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls") pod "dns-default-b24bq" (UID: "37b10fba-cd73-4823-a265-170d76851a3f") : secret "dns-default-metrics-tls" not found
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.417434    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.417491    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert podName:aace608b-8d23-4025-8571-bccbfcd09df0 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:40.917475292 +0000 UTC m=+36.621318273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tfrmw" (UID: "aace608b-8d23-4025-8571-bccbfcd09df0") : secret "networking-console-plugin-cert" not found
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.417638    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aace608b-8d23-4025-8571-bccbfcd09df0-nginx-conf\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.417757 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.417725    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37b10fba-cd73-4823-a265-170d76851a3f-tmp-dir\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.418549 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.418337    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f0f3a578-c2f9-424c-82ec-51cf40f8450b-config\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.418603 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.418551    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/543034bc-8c58-4864-a980-69b199df8d54-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.419175 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.419139    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-default-certificate\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.419264 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.419199    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/736abb7e-7095-4c23-b845-0d1de077de57-serving-cert\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.420492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.419655    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-snapshots\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.420595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.419837    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.420595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.419908    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3339a813-1197-4748-b594-af4a7bbfdf87-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.420595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.420057    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.420595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.420329    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3339a813-1197-4748-b594-af4a7bbfdf87-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.420595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.420334    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-stats-auth\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.420595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.420346    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-serving-cert\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.420910 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.420679    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/736abb7e-7095-4c23-b845-0d1de077de57-trusted-ca\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.420910 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.420762    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f0f3a578-c2f9-424c-82ec-51cf40f8450b-serving-cert\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.422466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.422446    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3-cert\") pod \"ingress-canary-dgxkx\" (UID: \"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3\") " pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.430581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.430519    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fltxx\" (UniqueName: \"kubernetes.io/projected/2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3-kube-api-access-fltxx\") pod \"ingress-canary-dgxkx\" (UID: \"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3\") " pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.430794 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.430750    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx56x\" (UniqueName: \"kubernetes.io/projected/7e32abf4-3a35-4ea2-a571-731885501900-kube-api-access-cx56x\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.431155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.431099    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfxw\" (UniqueName: \"kubernetes.io/projected/543034bc-8c58-4864-a980-69b199df8d54-kube-api-access-rmfxw\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.431155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.431107    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlc5s\" (UniqueName: \"kubernetes.io/projected/81b11609-f905-4439-8ca5-1d67e72cbf45-kube-api-access-wlc5s\") pod \"network-check-source-685456655f-crw2t\" (UID: \"81b11609-f905-4439-8ca5-1d67e72cbf45\") " pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t"
Sep 08 16:30:40.431543 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.431395    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xszwg\" (UniqueName: \"kubernetes.io/projected/f2e3ee59-cc2b-493f-a3af-71c39a1ac74d-kube-api-access-xszwg\") pod \"volume-data-source-validator-695c895bd6-s44v8\" (UID: \"f2e3ee59-cc2b-493f-a3af-71c39a1ac74d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"
Sep 08 16:30:40.432524 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.432496    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmqjf\" (UniqueName: \"kubernetes.io/projected/6ce3e03d-cc35-4f23-b7cf-209b3abb5edc-kube-api-access-rmqjf\") pod \"insights-operator-76bcd6ccf5-n5dsv\" (UID: \"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc\") " pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.433466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.433442    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr4mj\" (UniqueName: \"kubernetes.io/projected/f0f3a578-c2f9-424c-82ec-51cf40f8450b-kube-api-access-sr4mj\") pod \"service-ca-operator-859f94c4b-7vvg4\" (UID: \"f0f3a578-c2f9-424c-82ec-51cf40f8450b\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.433564 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.433442    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jftqt\" (UniqueName: \"kubernetes.io/projected/37b10fba-cd73-4823-a265-170d76851a3f-kube-api-access-jftqt\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.433797 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.433760    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65m8n\" (UniqueName: \"kubernetes.io/projected/3339a813-1197-4748-b594-af4a7bbfdf87-kube-api-access-65m8n\") pod \"kube-storage-version-migrator-operator-8d7dd4675-qc9bz\" (UID: \"3339a813-1197-4748-b594-af4a7bbfdf87\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.434153 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.434134    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xbdj\" (UniqueName: \"kubernetes.io/projected/736abb7e-7095-4c23-b845-0d1de077de57-kube-api-access-5xbdj\") pod \"console-operator-85b454874b-hm59v\" (UID: \"736abb7e-7095-4c23-b845-0d1de077de57\") " pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.434900 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.434865    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65xct\" (UniqueName: \"kubernetes.io/projected/272ce978-010b-40c1-bfa8-6e273be82289-kube-api-access-65xct\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.465466 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.465435    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"
Sep 08 16:30:40.491839 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.491521    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv"
Sep 08 16:30:40.498992 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.498965    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:30:40.505130 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.505106    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"
Sep 08 16:30:40.511093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.511069    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"
Sep 08 16:30:40.539431 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.539121    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dgxkx"
Sep 08 16:30:40.544256 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.543963    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t"
Sep 08 16:30:40.767425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.767219    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz"]
Sep 08 16:30:40.770301 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.770277    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3339a813_1197_4748_b594_af4a7bbfdf87.slice/crio-8a759601c44d8d3e9e2ef930f3bd8a3573a5f1e213a5ff37ca7bb76672719b5d WatchSource:0}: Error finding container 8a759601c44d8d3e9e2ef930f3bd8a3573a5f1e213a5ff37ca7bb76672719b5d: Status 404 returned error can't find the container with id 8a759601c44d8d3e9e2ef930f3bd8a3573a5f1e213a5ff37ca7bb76672719b5d
Sep 08 16:30:40.814598 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.814555    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-hm59v"]
Sep 08 16:30:40.817758 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.817731    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-n5dsv"]
Sep 08 16:30:40.818899 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.818868    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod736abb7e_7095_4c23_b845_0d1de077de57.slice/crio-6cc8ee30b34b622ae1ccbca45a5c910f73acd4792425cd0e40cbab77a68ed018 WatchSource:0}: Error finding container 6cc8ee30b34b622ae1ccbca45a5c910f73acd4792425cd0e40cbab77a68ed018: Status 404 returned error can't find the container with id 6cc8ee30b34b622ae1ccbca45a5c910f73acd4792425cd0e40cbab77a68ed018
Sep 08 16:30:40.820097 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.820074    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:40.820268 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.820250    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:30:40.820346 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.820271    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d475cd58f-fzv6w: secret "image-registry-tls" not found
Sep 08 16:30:40.820346 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.820317    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls podName:d4f96a09-2c50-452e-acfb-2b9a39825902 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.820299713 +0000 UTC m=+37.524142705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls") pod "image-registry-5d475cd58f-fzv6w" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902") : secret "image-registry-tls" not found
Sep 08 16:30:40.820462 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.820395    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce3e03d_cc35_4f23_b7cf_209b3abb5edc.slice/crio-94423c2f33f4eb6b0c014f3d0f296cfb934258277c3d6d1e5fb610c318d0120f WatchSource:0}: Error finding container 94423c2f33f4eb6b0c014f3d0f296cfb934258277c3d6d1e5fb610c318d0120f: Status 404 returned error can't find the container with id 94423c2f33f4eb6b0c014f3d0f296cfb934258277c3d6d1e5fb610c318d0120f
Sep 08 16:30:40.822450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.822427    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8"]
Sep 08 16:30:40.826154 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.826128    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4"]
Sep 08 16:30:40.826252 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.826173    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e3ee59_cc2b_493f_a3af_71c39a1ac74d.slice/crio-d6a175ba69a7a5f1eafcf3045f5b92383486553b387e6f44d336b1bddeaae03c WatchSource:0}: Error finding container d6a175ba69a7a5f1eafcf3045f5b92383486553b387e6f44d336b1bddeaae03c: Status 404 returned error can't find the container with id d6a175ba69a7a5f1eafcf3045f5b92383486553b387e6f44d336b1bddeaae03c
Sep 08 16:30:40.826450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.826430    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:30:40.826521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.826463    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:30:40.830862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.829444    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 16:30:40.830862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.829670    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6b8s\""
Sep 08 16:30:40.830862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.829738    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86r89\""
Sep 08 16:30:40.832216 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.832194    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0f3a578_c2f9_424c_82ec_51cf40f8450b.slice/crio-a7c6fe141e72b1596221856204326c63294733f71332d81b639fe46cc8737996 WatchSource:0}: Error finding container a7c6fe141e72b1596221856204326c63294733f71332d81b639fe46cc8737996: Status 404 returned error can't find the container with id a7c6fe141e72b1596221856204326c63294733f71332d81b639fe46cc8737996
Sep 08 16:30:40.875705 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.875674    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dgxkx"]
Sep 08 16:30:40.879053 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.878997    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-crw2t"]
Sep 08 16:30:40.879563 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.879534    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba24b9b_ced8_4d3c_8f7e_6b7cc99693f3.slice/crio-1e9cf3e73b9c4b1bf8dc91fe3f5e49b6ee2753b624f9f3cc5cc3de969e4c3467 WatchSource:0}: Error finding container 1e9cf3e73b9c4b1bf8dc91fe3f5e49b6ee2753b624f9f3cc5cc3de969e4c3467: Status 404 returned error can't find the container with id 1e9cf3e73b9c4b1bf8dc91fe3f5e49b6ee2753b624f9f3cc5cc3de969e4c3467
Sep 08 16:30:40.882961 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:30:40.882941    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b11609_f905_4439_8ca5_1d67e72cbf45.slice/crio-d5c70c8ea97fef73ffdbdced5313fc7d09f6cc8699613591d0375903d74cd5ef WatchSource:0}: Error finding container d5c70c8ea97fef73ffdbdced5313fc7d09f6cc8699613591d0375903d74cd5ef: Status 404 returned error can't find the container with id d5c70c8ea97fef73ffdbdced5313fc7d09f6cc8699613591d0375903d74cd5ef
Sep 08 16:30:40.921185 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.921143    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:40.921347 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.921192    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:40.921347 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.921246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.921347 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.921278    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:40.921347 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921306    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:30:40.921347 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921341    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.921319    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921379    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.921359221 +0000 UTC m=+37.625202214 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : configmap references non-existent config key: service-ca.crt
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921387    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921405    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls podName:37b10fba-cd73-4823-a265-170d76851a3f nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.921389692 +0000 UTC m=+37.625232673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls") pod "dns-default-b24bq" (UID: "37b10fba-cd73-4823-a265-170d76851a3f") : secret "dns-default-metrics-tls" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921430    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.921420723 +0000 UTC m=+37.625263715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : secret "router-metrics-certs-default" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921440    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921446    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert podName:aace608b-8d23-4025-8571-bccbfcd09df0 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.921441078 +0000 UTC m=+37.625284056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tfrmw" (UID: "aace608b-8d23-4025-8571-bccbfcd09df0") : secret "networking-console-plugin-cert" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921489    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls podName:543034bc-8c58-4864-a980-69b199df8d54 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.92147467 +0000 UTC m=+37.625317662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-zljt7" (UID: "543034bc-8c58-4864-a980-69b199df8d54") : secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:40.921581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:40.921536    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:40.921910 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921613    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 16:30:40.921910 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:40.921649    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls podName:7e32abf4-3a35-4ea2-a571-731885501900 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:41.9216366 +0000 UTC m=+37.625479621 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m9pv8" (UID: "7e32abf4-3a35-4ea2-a571-731885501900") : secret "samples-operator-tls" not found
Sep 08 16:30:41.001091 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.001057    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8" event={"ID":"f2e3ee59-cc2b-493f-a3af-71c39a1ac74d","Type":"ContainerStarted","Data":"d6a175ba69a7a5f1eafcf3045f5b92383486553b387e6f44d336b1bddeaae03c"}
Sep 08 16:30:41.002110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.002086    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4" event={"ID":"f0f3a578-c2f9-424c-82ec-51cf40f8450b","Type":"ContainerStarted","Data":"a7c6fe141e72b1596221856204326c63294733f71332d81b639fe46cc8737996"}
Sep 08 16:30:41.003307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.003273    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgxkx" event={"ID":"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3","Type":"ContainerStarted","Data":"1e9cf3e73b9c4b1bf8dc91fe3f5e49b6ee2753b624f9f3cc5cc3de969e4c3467"}
Sep 08 16:30:41.004408 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.004389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t" event={"ID":"81b11609-f905-4439-8ca5-1d67e72cbf45","Type":"ContainerStarted","Data":"d5c70c8ea97fef73ffdbdced5313fc7d09f6cc8699613591d0375903d74cd5ef"}
Sep 08 16:30:41.005374 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.005357    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-hm59v" event={"ID":"736abb7e-7095-4c23-b845-0d1de077de57","Type":"ContainerStarted","Data":"6cc8ee30b34b622ae1ccbca45a5c910f73acd4792425cd0e40cbab77a68ed018"}
Sep 08 16:30:41.006433 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.006416    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv" event={"ID":"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc","Type":"ContainerStarted","Data":"94423c2f33f4eb6b0c014f3d0f296cfb934258277c3d6d1e5fb610c318d0120f"}
Sep 08 16:30:41.007441 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.007415    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz" event={"ID":"3339a813-1197-4748-b594-af4a7bbfdf87","Type":"ContainerStarted","Data":"8a759601c44d8d3e9e2ef930f3bd8a3573a5f1e213a5ff37ca7bb76672719b5d"}
Sep 08 16:30:41.827332 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.827296    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:30:41.831054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.831013    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 16:30:41.831910 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.831349    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:41.831910 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.831521    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:30:41.831910 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.831536    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d475cd58f-fzv6w: secret "image-registry-tls" not found
Sep 08 16:30:41.831910 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.831591    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls podName:d4f96a09-2c50-452e-acfb-2b9a39825902 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.831571537 +0000 UTC m=+39.535414533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls") pod "image-registry-5d475cd58f-fzv6w" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902") : secret "image-registry-tls" not found
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.932550    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.932605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.932668    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.932717    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.932762    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:41.932852    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933058    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933129    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls podName:7e32abf4-3a35-4ea2-a571-731885501900 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.933109547 +0000 UTC m=+39.636952527 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m9pv8" (UID: "7e32abf4-3a35-4ea2-a571-731885501900") : secret "samples-operator-tls" not found
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933535    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933592    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls podName:37b10fba-cd73-4823-a265-170d76851a3f nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.933576831 +0000 UTC m=+39.637419824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls") pod "dns-default-b24bq" (UID: "37b10fba-cd73-4823-a265-170d76851a3f") : secret "dns-default-metrics-tls" not found
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933654    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 16:30:41.933684 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933688    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert podName:aace608b-8d23-4025-8571-bccbfcd09df0 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.933676569 +0000 UTC m=+39.637519562 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tfrmw" (UID: "aace608b-8d23-4025-8571-bccbfcd09df0") : secret "networking-console-plugin-cert" not found
Sep 08 16:30:41.934399 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933754    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.933744043 +0000 UTC m=+39.637587035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : configmap references non-existent config key: service-ca.crt
Sep 08 16:30:41.934399 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933828    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:41.934399 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933863    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls podName:543034bc-8c58-4864-a980-69b199df8d54 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.933851415 +0000 UTC m=+39.637694397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-zljt7" (UID: "543034bc-8c58-4864-a980-69b199df8d54") : secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:41.934399 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933917    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 16:30:41.934399 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:41.933948    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:43.933938253 +0000 UTC m=+39.637781247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : secret "router-metrics-certs-default" not found
Sep 08 16:30:43.852930 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.852837    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:43.853443 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.853024    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:30:43.853443 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.853046    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d475cd58f-fzv6w: secret "image-registry-tls" not found
Sep 08 16:30:43.853443 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.853112    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls podName:d4f96a09-2c50-452e-acfb-2b9a39825902 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.853092011 +0000 UTC m=+43.556935012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls") pod "image-registry-5d475cd58f-fzv6w" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902") : secret "image-registry-tls" not found
Sep 08 16:30:43.955076 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.955033    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:43.955268 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.955106    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:43.955268 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955207    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:43.955268 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.955185    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:43.955268 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.955262    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955289    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls podName:543034bc-8c58-4864-a980-69b199df8d54 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.955266055 +0000 UTC m=+43.659109040 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-zljt7" (UID: "543034bc-8c58-4864-a980-69b199df8d54") : secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.955336    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955346    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955396    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls podName:37b10fba-cd73-4823-a265-170d76851a3f nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.955379834 +0000 UTC m=+43.659222828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls") pod "dns-default-b24bq" (UID: "37b10fba-cd73-4823-a265-170d76851a3f") : secret "dns-default-metrics-tls" not found
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955433    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955472    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert podName:aace608b-8d23-4025-8571-bccbfcd09df0 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.955460447 +0000 UTC m=+43.659303428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tfrmw" (UID: "aace608b-8d23-4025-8571-bccbfcd09df0") : secret "networking-console-plugin-cert" not found
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:43.955432    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:43.955508 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955498    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.955487271 +0000 UTC m=+43.659330268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : configmap references non-existent config key: service-ca.crt
Sep 08 16:30:43.955925 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955552    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 16:30:43.955925 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955583    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.955573532 +0000 UTC m=+43.659416525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : secret "router-metrics-certs-default" not found
Sep 08 16:30:43.955925 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955634    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 16:30:43.955925 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:43.955665    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls podName:7e32abf4-3a35-4ea2-a571-731885501900 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:47.955654704 +0000 UTC m=+43.659497715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m9pv8" (UID: "7e32abf4-3a35-4ea2-a571-731885501900") : secret "samples-operator-tls" not found
Sep 08 16:30:47.889590 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.889547    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:47.890060 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.889733    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:30:47.890060 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.889759    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d475cd58f-fzv6w: secret "image-registry-tls" not found
Sep 08 16:30:47.890060 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.889853    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls podName:d4f96a09-2c50-452e-acfb-2b9a39825902 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.889830997 +0000 UTC m=+51.593673979 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls") pod "image-registry-5d475cd58f-fzv6w" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902") : secret "image-registry-tls" not found
Sep 08 16:30:47.990929 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.990888    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:47.991118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.990954    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:47.991118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.990986    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:47.991118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.991021    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:47.991118 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991066    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 16:30:47.991118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.991090    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:47.991118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:47.991117    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991135    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert podName:aace608b-8d23-4025-8571-bccbfcd09df0 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.991114353 +0000 UTC m=+51.694957338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tfrmw" (UID: "aace608b-8d23-4025-8571-bccbfcd09df0") : secret "networking-console-plugin-cert" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991166    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991169    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991210    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.991197072 +0000 UTC m=+51.695040050 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : configmap references non-existent config key: service-ca.crt
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991176    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991229    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991262    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.991252322 +0000 UTC m=+51.695095301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : secret "router-metrics-certs-default" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991276    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls podName:543034bc-8c58-4864-a980-69b199df8d54 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.991268896 +0000 UTC m=+51.695111879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-zljt7" (UID: "543034bc-8c58-4864-a980-69b199df8d54") : secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991289    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls podName:37b10fba-cd73-4823-a265-170d76851a3f nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.991282092 +0000 UTC m=+51.695125069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls") pod "dns-default-b24bq" (UID: "37b10fba-cd73-4823-a265-170d76851a3f") : secret "dns-default-metrics-tls" not found
Sep 08 16:30:47.991372 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:47.991302    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls podName:7e32abf4-3a35-4ea2-a571-731885501900 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:55.991295502 +0000 UTC m=+51.695138493 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m9pv8" (UID: "7e32abf4-3a35-4ea2-a571-731885501900") : secret "samples-operator-tls" not found
Sep 08 16:30:51.044003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.043970    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t" event={"ID":"81b11609-f905-4439-8ca5-1d67e72cbf45","Type":"ContainerStarted","Data":"90d1bfc8a9a0a75a69e0ede9a53c88d6c8b65457b3ead443d86d04367756830b"}
Sep 08 16:30:51.046086 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.046046    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/0.log"
Sep 08 16:30:51.046214 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.046104    2547 generic.go:356] "Generic (PLEG): container finished" podID="736abb7e-7095-4c23-b845-0d1de077de57" containerID="56f5ca872e8d60fe0e6249ca774a3278d6f4f44f4df36061383e9b8d9a82eb35" exitCode=255
Sep 08 16:30:51.046214 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.046189    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-hm59v" event={"ID":"736abb7e-7095-4c23-b845-0d1de077de57","Type":"ContainerDied","Data":"56f5ca872e8d60fe0e6249ca774a3278d6f4f44f4df36061383e9b8d9a82eb35"}
Sep 08 16:30:51.046326 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.046316    2547 scope.go:117] "RemoveContainer" containerID="56f5ca872e8d60fe0e6249ca774a3278d6f4f44f4df36061383e9b8d9a82eb35"
Sep 08 16:30:51.048957 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.048106    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv" event={"ID":"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc","Type":"ContainerStarted","Data":"edc0bad6b22d285faed5fadaea6108b35ca1a4027dd862d82665cf6686963b96"}
Sep 08 16:30:51.050053 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.050012    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz" event={"ID":"3339a813-1197-4748-b594-af4a7bbfdf87","Type":"ContainerStarted","Data":"1834ed630126bf5efd2b2daacd4d237d233271e2f1593e4da73401aed8049add"}
Sep 08 16:30:51.051447 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.051426    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8" event={"ID":"f2e3ee59-cc2b-493f-a3af-71c39a1ac74d","Type":"ContainerStarted","Data":"1e49b11a6aa252d5890cd373fbede8e6d72b53a7a090b7d0a57fdd8e01b04844"}
Sep 08 16:30:51.052734 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.052715    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4" event={"ID":"f0f3a578-c2f9-424c-82ec-51cf40f8450b","Type":"ContainerStarted","Data":"4d4bfa68e06e49ec54b9ce9615f98fefde0283fbb0f12e61e023912a76e37c20"}
Sep 08 16:30:51.061177 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.061132    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-crw2t" podStartSLOduration=12.188094225 podStartE2EDuration="22.061117441s" totalImagesPullingTime="9.873023216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:51.060632892 +0000 UTC m=+46.764475894" watchObservedRunningTime="2026-09-08 16:30:51.061117441 +0000 UTC m=+46.764960441"
Sep 08 16:30:51.086762 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.086700    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv" podStartSLOduration=12.151888747 podStartE2EDuration="22.086655732s" totalImagesPullingTime="9.934766985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:51.08399931 +0000 UTC m=+46.787842312" watchObservedRunningTime="2026-09-08 16:30:51.086655732 +0000 UTC m=+46.790498733"
Sep 08 16:30:51.137623 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.137563    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4" podStartSLOduration=12.213990091 podStartE2EDuration="22.13753787s" totalImagesPullingTime="9.923547779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:51.115422565 +0000 UTC m=+46.819265568" watchObservedRunningTime="2026-09-08 16:30:51.13753787 +0000 UTC m=+46.841380876"
Sep 08 16:30:51.137818 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.137690    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-s44v8" podStartSLOduration=14.45431387 podStartE2EDuration="22.137679666s" totalImagesPullingTime="7.683365796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:51.136227053 +0000 UTC m=+46.840070055" watchObservedRunningTime="2026-09-08 16:30:51.137679666 +0000 UTC m=+46.841522667"
Sep 08 16:30:51.161090 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:51.160256    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz" podStartSLOduration=12.173638075 podStartE2EDuration="22.160236035s" totalImagesPullingTime="9.98659796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:51.159152471 +0000 UTC m=+46.862995478" watchObservedRunningTime="2026-09-08 16:30:51.160236035 +0000 UTC m=+46.864079034"
Sep 08 16:30:52.059745 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.059705    2547 generic.go:356] "Generic (PLEG): container finished" podID="fd226f21-edbd-4fce-ba8a-7b92513e93ed" containerID="884b6f8436320b40adfc0fc599c234dc98b4d0b50c3f89503f3a79746989eb10" exitCode=0
Sep 08 16:30:52.060273 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.059806    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerDied","Data":"884b6f8436320b40adfc0fc599c234dc98b4d0b50c3f89503f3a79746989eb10"}
Sep 08 16:30:52.063459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.063426    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dgxkx" event={"ID":"2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3","Type":"ContainerStarted","Data":"9b582092b900550ce462a6a51859b18e07cde59637b0c857ce2c488a312474c5"}
Sep 08 16:30:52.065875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.065216    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:30:52.065875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.065610    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/0.log"
Sep 08 16:30:52.065875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.065634    2547 generic.go:356] "Generic (PLEG): container finished" podID="736abb7e-7095-4c23-b845-0d1de077de57" containerID="dbd5b09e732184d0bb1da5443381a9482b5417ad5aea8c6bbe17ef8baf3b001b" exitCode=255
Sep 08 16:30:52.066154 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.066138    2547 scope.go:117] "RemoveContainer" containerID="dbd5b09e732184d0bb1da5443381a9482b5417ad5aea8c6bbe17ef8baf3b001b"
Sep 08 16:30:52.066275 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:52.066257    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-hm59v_openshift-console-operator(736abb7e-7095-4c23-b845-0d1de077de57)\"" pod="openshift-console-operator/console-operator-85b454874b-hm59v" podUID="736abb7e-7095-4c23-b845-0d1de077de57"
Sep 08 16:30:52.066330 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.066287    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-hm59v" event={"ID":"736abb7e-7095-4c23-b845-0d1de077de57","Type":"ContainerDied","Data":"dbd5b09e732184d0bb1da5443381a9482b5417ad5aea8c6bbe17ef8baf3b001b"}
Sep 08 16:30:52.066330 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.066316    2547 scope.go:117] "RemoveContainer" containerID="56f5ca872e8d60fe0e6249ca774a3278d6f4f44f4df36061383e9b8d9a82eb35"
Sep 08 16:30:52.106739 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.106506    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dgxkx" podStartSLOduration=2.221081913 podStartE2EDuration="12.106484115s" totalImagesPullingTime="9.885402202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:52.10577372 +0000 UTC m=+47.809616721" watchObservedRunningTime="2026-09-08 16:30:52.106484115 +0000 UTC m=+47.810327116"
Sep 08 16:30:52.426415 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.426376    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-swlqn"]
Sep 08 16:30:52.442308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.442273    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.444731 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.444706    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swlqn"]
Sep 08 16:30:52.445178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.444923    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 16:30:52.445587 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.445549    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 16:30:52.446814 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.446424    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mpsgj\""
Sep 08 16:30:52.539369 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.539321    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.539545 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.539394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-crio-socket\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.539545 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.539441    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.539654 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.539548    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-data-volume\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.539705 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.539652    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tf2g\" (UniqueName: \"kubernetes.io/projected/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-api-access-6tf2g\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.640962 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.640873    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-data-volume\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.641126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.640965    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tf2g\" (UniqueName: \"kubernetes.io/projected/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-api-access-6tf2g\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.641126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.640990    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.641126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.641015    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-crio-socket\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.641126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.641056    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.641126 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:52.641096    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:30:52.641373 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:52.641161    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:30:53.141141633 +0000 UTC m=+48.844984628 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : configmap "kube-rbac-proxy" not found
Sep 08 16:30:52.641373 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:52.641183    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:52.641373 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:52.641232    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:30:53.141220316 +0000 UTC m=+48.845063299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:52.641373 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.641234    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-data-volume\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.641373 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.641234    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-crio-socket\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:52.651713 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:52.651680    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tf2g\" (UniqueName: \"kubernetes.io/projected/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-api-access-6tf2g\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:53.072708 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.072673    2547 generic.go:356] "Generic (PLEG): container finished" podID="fd226f21-edbd-4fce-ba8a-7b92513e93ed" containerID="539113eaec4fe35ee8245ba20337dd0d75e47faf509e5476187c1c16a57eefeb" exitCode=0
Sep 08 16:30:53.073129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.072744    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerDied","Data":"539113eaec4fe35ee8245ba20337dd0d75e47faf509e5476187c1c16a57eefeb"}
Sep 08 16:30:53.074381 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.074363    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:30:53.074666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.074649    2547 scope.go:117] "RemoveContainer" containerID="dbd5b09e732184d0bb1da5443381a9482b5417ad5aea8c6bbe17ef8baf3b001b"
Sep 08 16:30:53.074831 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:53.074813    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-hm59v_openshift-console-operator(736abb7e-7095-4c23-b845-0d1de077de57)\"" pod="openshift-console-operator/console-operator-85b454874b-hm59v" podUID="736abb7e-7095-4c23-b845-0d1de077de57"
Sep 08 16:30:53.145753 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.145726    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:53.145928 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:53.145904    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:30:53.146028 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:53.146015    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:30:54.145990163 +0000 UTC m=+49.849833168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : configmap "kube-rbac-proxy" not found
Sep 08 16:30:53.146102 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.146082    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:53.146207 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:53.146180    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:53.146269 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:53.146241    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:30:54.146224591 +0000 UTC m=+49.850067583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:53.805524 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:53.805495    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mzbwf_933cddf1-a897-4907-a4a7-6a1c09f95264/dns-node-resolver/0.log"
Sep 08 16:30:54.081922 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:54.081842    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cpclg" event={"ID":"fd226f21-edbd-4fce-ba8a-7b92513e93ed","Type":"ContainerStarted","Data":"25064b164660333674b401dd1c0074baff16311018cd49ac852aacfa9b5eec05"}
Sep 08 16:30:54.108495 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:54.108432    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cpclg" podStartSLOduration=9.148364545 podStartE2EDuration="49.108409699s" totalImagesPullingTime="39.960045154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:54.106179901 +0000 UTC m=+49.810022901" watchObservedRunningTime="2026-09-08 16:30:54.108409699 +0000 UTC m=+49.812252704"
Sep 08 16:30:54.154656 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:54.154615    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:54.154885 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:54.154694    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:54.154885 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:54.154734    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 16:30:54.154885 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:54.154823    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:30:56.154801611 +0000 UTC m=+51.858644606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : configmap "kube-rbac-proxy" not found
Sep 08 16:30:54.155071 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:54.154891    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:54.155071 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:54.154973    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:30:56.154956179 +0000 UTC m=+51.858799170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:54.794243 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:54.794214    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htghg_2df1a785-3dd3-4636-b3ea-c738d46b0e84/node-ca/0.log"
Sep 08 16:30:55.594633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:55.594601    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgxkx_2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3/serve-healthcheck-canary/0.log"
Sep 08 16:30:55.969425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:55.969347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:30:55.969561 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:55.969496    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 16:30:55.969561 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:55.969528    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d475cd58f-fzv6w: secret "image-registry-tls" not found
Sep 08 16:30:55.969659 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:55.969586    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls podName:d4f96a09-2c50-452e-acfb-2b9a39825902 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:11.969570769 +0000 UTC m=+67.673413750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls") pod "image-registry-5d475cd58f-fzv6w" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902") : secret "image-registry-tls" not found
Sep 08 16:30:56.070500 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.070468    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:56.070667 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.070512    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:30:56.070667 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.070562    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:30:56.070667 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070640    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:12.070618426 +0000 UTC m=+67.774461426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : configmap references non-existent config key: service-ca.crt
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.070684    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070696    2547 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070693    2547 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.070732    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070751    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls podName:543034bc-8c58-4864-a980-69b199df8d54 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:12.070743357 +0000 UTC m=+67.774586337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-zljt7" (UID: "543034bc-8c58-4864-a980-69b199df8d54") : secret "cluster-monitoring-operator-tls" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.070770    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070806    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070836    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls podName:37b10fba-cd73-4823-a265-170d76851a3f nodeName:}" failed. No retries permitted until 2026-09-08 16:31:12.070824181 +0000 UTC m=+67.774667163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls") pod "dns-default-b24bq" (UID: "37b10fba-cd73-4823-a265-170d76851a3f") : secret "dns-default-metrics-tls" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070837    2547 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070892    2547 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070897    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls podName:7e32abf4-3a35-4ea2-a571-731885501900 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:12.070880646 +0000 UTC m=+67.774723626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-m9pv8" (UID: "7e32abf4-3a35-4ea2-a571-731885501900") : secret "samples-operator-tls" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070921    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert podName:aace608b-8d23-4025-8571-bccbfcd09df0 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:12.070913643 +0000 UTC m=+67.774756625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-tfrmw" (UID: "aace608b-8d23-4025-8571-bccbfcd09df0") : secret "networking-console-plugin-cert" not found
Sep 08 16:30:56.070945 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.070945    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs podName:272ce978-010b-40c1-bfa8-6e273be82289 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:12.070933847 +0000 UTC m=+67.774776829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs") pod "router-default-5bb6f6fcf8-cxp7q" (UID: "272ce978-010b-40c1-bfa8-6e273be82289") : secret "router-metrics-certs-default" not found
Sep 08 16:30:56.171446 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.171406    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:56.171631 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.171467    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:30:56.171631 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.171604    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:56.171712 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:30:56.171675    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:31:00.171655921 +0000 UTC m=+55.875498899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:30:56.172116 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:30:56.172097    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:31:00.204517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:00.204464    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:31:00.205000 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:00.204622    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 16:31:00.205000 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:00.204692    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls podName:72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c nodeName:}" failed. No retries permitted until 2026-09-08 16:31:08.204676398 +0000 UTC m=+63.908519380 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-swlqn" (UID: "72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c") : secret "insights-runtime-extractor-tls" not found
Sep 08 16:31:00.499965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:00.499875    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:31:00.499965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:00.499931    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:31:00.500291 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:00.500278    2547 scope.go:117] "RemoveContainer" containerID="dbd5b09e732184d0bb1da5443381a9482b5417ad5aea8c6bbe17ef8baf3b001b"
Sep 08 16:31:00.500442 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:00.500424    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-hm59v_openshift-console-operator(736abb7e-7095-4c23-b845-0d1de077de57)\"" pod="openshift-console-operator/console-operator-85b454874b-hm59v" podUID="736abb7e-7095-4c23-b845-0d1de077de57"
Sep 08 16:31:05.996670 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:05.996640    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4qz6l"
Sep 08 16:31:08.278901 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:08.278860    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:31:08.281197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:08.281174    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-swlqn\" (UID: \"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c\") " pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:31:08.357139 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:08.357102    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mpsgj\""
Sep 08 16:31:08.364981 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:08.364959    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-swlqn"
Sep 08 16:31:08.635993 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:08.635918    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-swlqn"]
Sep 08 16:31:08.638737 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:08.638712    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ee6e8a_1f6b_48b9_86c4_641c9a1e7b5c.slice/crio-91567fdbb2fc5f989f140c2c9a6a4d38e0fc55c138d179783515aa3360d55033 WatchSource:0}: Error finding container 91567fdbb2fc5f989f140c2c9a6a4d38e0fc55c138d179783515aa3360d55033: Status 404 returned error can't find the container with id 91567fdbb2fc5f989f140c2c9a6a4d38e0fc55c138d179783515aa3360d55033
Sep 08 16:31:09.129210 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:09.129177    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swlqn" event={"ID":"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c","Type":"ContainerStarted","Data":"3756f59061f1efd9450acac87c12cec3360a7cc6c7aa327fb7bdedcad35351a8"}
Sep 08 16:31:09.129368 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:09.129229    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swlqn" event={"ID":"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c","Type":"ContainerStarted","Data":"91567fdbb2fc5f989f140c2c9a6a4d38e0fc55c138d179783515aa3360d55033"}
Sep 08 16:31:10.134874 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.134830    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swlqn" event={"ID":"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c","Type":"ContainerStarted","Data":"babbbef2579e6dae7aa5839e96fc2a6a06f9526ae4f18dafa7b23bc41b689732"}
Sep 08 16:31:10.500295 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.500208    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:31:10.500456 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.500318    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:31:10.502879 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.502858    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 16:31:10.503249 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.503228    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnztr\" (UniqueName: \"kubernetes.io/projected/e8caee6c-1a8f-43cf-a9cd-e064a236ee16-kube-api-access-fnztr\") pod \"network-check-target-ls2d6\" (UID: \"e8caee6c-1a8f-43cf-a9cd-e064a236ee16\") " pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:31:10.513242 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.513214    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fde2ef97-46ba-4e3d-b873-472072d6b408-metrics-certs\") pod \"network-metrics-daemon-cswl9\" (UID: \"fde2ef97-46ba-4e3d-b873-472072d6b408\") " pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:31:10.545072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.545040    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86r89\""
Sep 08 16:31:10.551139 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.551108    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6b8s\""
Sep 08 16:31:10.552123 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.552106    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:31:10.559938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.559896    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cswl9"
Sep 08 16:31:10.601023 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.600991    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:31:10.603819 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.603774    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 16:31:10.614381 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.614323    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b8c71dfb-970d-456f-9524-ed93a7904850-original-pull-secret\") pod \"global-pull-secret-syncer-qkf2f\" (UID: \"b8c71dfb-970d-456f-9524-ed93a7904850\") " pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:31:10.652179 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.651059    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qkf2f"
Sep 08 16:31:10.830611 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.830589    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ls2d6"]
Sep 08 16:31:10.861874 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.861841    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cswl9"]
Sep 08 16:31:10.942348 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:10.942317    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qkf2f"]
Sep 08 16:31:11.119599 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:11.119514    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfde2ef97_46ba_4e3d_b873_472072d6b408.slice/crio-1950b9fe4f8b25160db6b55d3f8a846890099972535e3abd40abf9a87860be01 WatchSource:0}: Error finding container 1950b9fe4f8b25160db6b55d3f8a846890099972535e3abd40abf9a87860be01: Status 404 returned error can't find the container with id 1950b9fe4f8b25160db6b55d3f8a846890099972535e3abd40abf9a87860be01
Sep 08 16:31:11.120105 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:11.120077    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c71dfb_970d_456f_9524_ed93a7904850.slice/crio-f6e9bd58390e9cc6a5661c0b6ce9c7157e908d2cce1ad74148a175ee80080a0c WatchSource:0}: Error finding container f6e9bd58390e9cc6a5661c0b6ce9c7157e908d2cce1ad74148a175ee80080a0c: Status 404 returned error can't find the container with id f6e9bd58390e9cc6a5661c0b6ce9c7157e908d2cce1ad74148a175ee80080a0c
Sep 08 16:31:11.120829 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:11.120809    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8caee6c_1a8f_43cf_a9cd_e064a236ee16.slice/crio-385f3cfbf3ba45b1214cc3162d8f3e83b57d65a5444314ffc98bfc0330b6083e WatchSource:0}: Error finding container 385f3cfbf3ba45b1214cc3162d8f3e83b57d65a5444314ffc98bfc0330b6083e: Status 404 returned error can't find the container with id 385f3cfbf3ba45b1214cc3162d8f3e83b57d65a5444314ffc98bfc0330b6083e
Sep 08 16:31:11.140184 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:11.140156    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cswl9" event={"ID":"fde2ef97-46ba-4e3d-b873-472072d6b408","Type":"ContainerStarted","Data":"1950b9fe4f8b25160db6b55d3f8a846890099972535e3abd40abf9a87860be01"}
Sep 08 16:31:11.141350 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:11.141326    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ls2d6" event={"ID":"e8caee6c-1a8f-43cf-a9cd-e064a236ee16","Type":"ContainerStarted","Data":"385f3cfbf3ba45b1214cc3162d8f3e83b57d65a5444314ffc98bfc0330b6083e"}
Sep 08 16:31:11.142312 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:11.142293    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qkf2f" event={"ID":"b8c71dfb-970d-456f-9524-ed93a7904850","Type":"ContainerStarted","Data":"f6e9bd58390e9cc6a5661c0b6ce9c7157e908d2cce1ad74148a175ee80080a0c"}
Sep 08 16:31:12.015084 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.015048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:31:12.017914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.017880    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"image-registry-5d475cd58f-fzv6w\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") " pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:31:12.116411 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.116375    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:31:12.116555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.116421    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:31:12.116555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.116442    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:31:12.116555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.116480    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:12.116555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.116505    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:31:12.116555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.116537    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:12.117377 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.117211    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/272ce978-010b-40c1-bfa8-6e273be82289-service-ca-bundle\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:12.119092 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.119066    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37b10fba-cd73-4823-a265-170d76851a3f-metrics-tls\") pod \"dns-default-b24bq\" (UID: \"37b10fba-cd73-4823-a265-170d76851a3f\") " pod="openshift-dns/dns-default-b24bq"
Sep 08 16:31:12.119199 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.119113    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/aace608b-8d23-4025-8571-bccbfcd09df0-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-tfrmw\" (UID: \"aace608b-8d23-4025-8571-bccbfcd09df0\") " pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:31:12.119199 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.119144    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e32abf4-3a35-4ea2-a571-731885501900-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-m9pv8\" (UID: \"7e32abf4-3a35-4ea2-a571-731885501900\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:31:12.119361 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.119344    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/543034bc-8c58-4864-a980-69b199df8d54-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-zljt7\" (UID: \"543034bc-8c58-4864-a980-69b199df8d54\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:31:12.119420 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.119399    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/272ce978-010b-40c1-bfa8-6e273be82289-metrics-certs\") pod \"router-default-5bb6f6fcf8-cxp7q\" (UID: \"272ce978-010b-40c1-bfa8-6e273be82289\") " pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:12.151429 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.151398    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-swlqn" event={"ID":"72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c","Type":"ContainerStarted","Data":"4ff2eb8e5b5ec3090eafdbbb399012d10e6a719b05613ce235ec4a48c8177f5b"}
Sep 08 16:31:12.152966 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.152942    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ls2d6" event={"ID":"e8caee6c-1a8f-43cf-a9cd-e064a236ee16","Type":"ContainerStarted","Data":"f6afa1e074f0569a9f7cf5004ccb569eff55d54e4ae26a81cd2f4c07c0ccba10"}
Sep 08 16:31:12.153077 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.153058    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:31:12.173666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.173591    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-swlqn" podStartSLOduration=17.757406165 podStartE2EDuration="20.173570863s" totalImagesPullingTime="2.416164698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:12.172445183 +0000 UTC m=+67.876288187" watchObservedRunningTime="2026-09-08 16:31:12.173570863 +0000 UTC m=+67.877413863"
Sep 08 16:31:12.237107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.237082    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-x6c7g\""
Sep 08 16:31:12.245663 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.245631    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:31:12.279517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.279491    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-g254h\""
Sep 08 16:31:12.288763 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.288663    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw"
Sep 08 16:31:12.320242 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.320216    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-jpmpb\""
Sep 08 16:31:12.324226 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.324199    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zsf6\""
Sep 08 16:31:12.327148 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.327126    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"
Sep 08 16:31:12.329360 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.329336    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ntnws\""
Sep 08 16:31:12.332873 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.332853    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b24bq"
Sep 08 16:31:12.336995 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.336621    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5jw2d\""
Sep 08 16:31:12.338189 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.338167    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:12.344195 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.344164    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"
Sep 08 16:31:12.528716 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.528616    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ls2d6" podStartSLOduration=67.528597797 podStartE2EDuration="1m7.528597797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:12.199205175 +0000 UTC m=+67.903048174" watchObservedRunningTime="2026-09-08 16:31:12.528597797 +0000 UTC m=+68.232440857"
Sep 08 16:31:12.529054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.529037    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d475cd58f-fzv6w"]
Sep 08 16:31:12.531269 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:12.531238    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4f96a09_2c50_452e_acfb_2b9a39825902.slice/crio-c115cd42a3f0fb973ced35c6ff205580e542bc50088cc44756392bde6dc3decc WatchSource:0}: Error finding container c115cd42a3f0fb973ced35c6ff205580e542bc50088cc44756392bde6dc3decc: Status 404 returned error can't find the container with id c115cd42a3f0fb973ced35c6ff205580e542bc50088cc44756392bde6dc3decc
Sep 08 16:31:12.578577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.578551    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-tfrmw"]
Sep 08 16:31:12.591698 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:12.591674    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaace608b_8d23_4025_8571_bccbfcd09df0.slice/crio-e04bc32d847cfdede6033217029bd8ceaba77b1c7e9d94e0f6ed66b4c8bc2b6e WatchSource:0}: Error finding container e04bc32d847cfdede6033217029bd8ceaba77b1c7e9d94e0f6ed66b4c8bc2b6e: Status 404 returned error can't find the container with id e04bc32d847cfdede6033217029bd8ceaba77b1c7e9d94e0f6ed66b4c8bc2b6e
Sep 08 16:31:12.623893 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.623866    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8"]
Sep 08 16:31:12.633949 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.633923    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b24bq"]
Sep 08 16:31:12.638866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.638678    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7"]
Sep 08 16:31:12.643132 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:12.642942    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b10fba_cd73_4823_a265_170d76851a3f.slice/crio-553be480992d5637be5dc211452bd327eb19a7388d9e9eaed18b24b3d8b51d6c WatchSource:0}: Error finding container 553be480992d5637be5dc211452bd327eb19a7388d9e9eaed18b24b3d8b51d6c: Status 404 returned error can't find the container with id 553be480992d5637be5dc211452bd327eb19a7388d9e9eaed18b24b3d8b51d6c
Sep 08 16:31:12.643345 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:12.643324    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod543034bc_8c58_4864_a980_69b199df8d54.slice/crio-e99844a940a932ea69cdf5b4a72c9bf452e327c32bc1cbe3970b82ced94b90f3 WatchSource:0}: Error finding container e99844a940a932ea69cdf5b4a72c9bf452e327c32bc1cbe3970b82ced94b90f3: Status 404 returned error can't find the container with id e99844a940a932ea69cdf5b4a72c9bf452e327c32bc1cbe3970b82ced94b90f3
Sep 08 16:31:12.663939 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:12.663914    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bb6f6fcf8-cxp7q"]
Sep 08 16:31:12.667517 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:12.667489    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod272ce978_010b_40c1_bfa8_6e273be82289.slice/crio-006053398fc71916a33d361b2e679a416bcfe79ad6140eb0338fca014f05c447 WatchSource:0}: Error finding container 006053398fc71916a33d361b2e679a416bcfe79ad6140eb0338fca014f05c447: Status 404 returned error can't find the container with id 006053398fc71916a33d361b2e679a416bcfe79ad6140eb0338fca014f05c447
Sep 08 16:31:13.158070 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.158035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7" event={"ID":"543034bc-8c58-4864-a980-69b199df8d54","Type":"ContainerStarted","Data":"e99844a940a932ea69cdf5b4a72c9bf452e327c32bc1cbe3970b82ced94b90f3"}
Sep 08 16:31:13.159322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.159302    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw" event={"ID":"aace608b-8d23-4025-8571-bccbfcd09df0","Type":"ContainerStarted","Data":"e04bc32d847cfdede6033217029bd8ceaba77b1c7e9d94e0f6ed66b4c8bc2b6e"}
Sep 08 16:31:13.160957 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.160936    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cswl9" event={"ID":"fde2ef97-46ba-4e3d-b873-472072d6b408","Type":"ContainerStarted","Data":"6dfbdcac41da763f890ab402ce2280df9158a6d26b82cb4a71d50c851768bba4"}
Sep 08 16:31:13.161066 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.160977    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cswl9" event={"ID":"fde2ef97-46ba-4e3d-b873-472072d6b408","Type":"ContainerStarted","Data":"5ad791ca85a28b4e5685c649446d2a30e3fbe55798e0f31c9d639d4c2cadaea8"}
Sep 08 16:31:13.162112 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.162096    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8" event={"ID":"7e32abf4-3a35-4ea2-a571-731885501900","Type":"ContainerStarted","Data":"06e1deb7ec692b66b75bbff2a02e995f2f41d00d8374de021d1d485ee7b833c5"}
Sep 08 16:31:13.163428 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.163411    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w" event={"ID":"d4f96a09-2c50-452e-acfb-2b9a39825902","Type":"ContainerStarted","Data":"c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450"}
Sep 08 16:31:13.163514 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.163439    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w" event={"ID":"d4f96a09-2c50-452e-acfb-2b9a39825902","Type":"ContainerStarted","Data":"c115cd42a3f0fb973ced35c6ff205580e542bc50088cc44756392bde6dc3decc"}
Sep 08 16:31:13.163585 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.163532    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:31:13.164947 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.164927    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q" event={"ID":"272ce978-010b-40c1-bfa8-6e273be82289","Type":"ContainerStarted","Data":"827378c4c5c38673c56d28e3d5576fab660daf757375a9919302c9f8eff5f3b8"}
Sep 08 16:31:13.165009 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.164962    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q" event={"ID":"272ce978-010b-40c1-bfa8-6e273be82289","Type":"ContainerStarted","Data":"006053398fc71916a33d361b2e679a416bcfe79ad6140eb0338fca014f05c447"}
Sep 08 16:31:13.166012 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.165995    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b24bq" event={"ID":"37b10fba-cd73-4823-a265-170d76851a3f","Type":"ContainerStarted","Data":"553be480992d5637be5dc211452bd327eb19a7388d9e9eaed18b24b3d8b51d6c"}
Sep 08 16:31:13.178397 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.178355    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cswl9" podStartSLOduration=67.161247419 podStartE2EDuration="1m8.178341607s" totalImagesPullingTime="1.017094188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:13.178111636 +0000 UTC m=+68.881954638" watchObservedRunningTime="2026-09-08 16:31:13.178341607 +0000 UTC m=+68.882184606"
Sep 08 16:31:13.200481 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.200433    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q" podStartSLOduration=44.200417926 podStartE2EDuration="44.200417926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:13.199212543 +0000 UTC m=+68.903055545" watchObservedRunningTime="2026-09-08 16:31:13.200417926 +0000 UTC m=+68.904260917"
Sep 08 16:31:13.339222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.339169    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:13.342141 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.342114    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:13.362365 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:13.362308    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w" podStartSLOduration=67.362287378 podStartE2EDuration="1m7.362287378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:13.222680124 +0000 UTC m=+68.926523123" watchObservedRunningTime="2026-09-08 16:31:13.362287378 +0000 UTC m=+69.066130378"
Sep 08 16:31:14.171320 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:14.171290    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:14.172865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:14.172828    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bb6f6fcf8-cxp7q"
Sep 08 16:31:14.829763 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:14.829685    2547 scope.go:117] "RemoveContainer" containerID="dbd5b09e732184d0bb1da5443381a9482b5417ad5aea8c6bbe17ef8baf3b001b"
Sep 08 16:31:16.182848 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.182508    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7" event={"ID":"543034bc-8c58-4864-a980-69b199df8d54","Type":"ContainerStarted","Data":"57aa54b1f505ccdc707ae527d7b41fa06c896a61c1007097c69087e909db968b"}
Sep 08 16:31:16.185808 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.185504    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw" event={"ID":"aace608b-8d23-4025-8571-bccbfcd09df0","Type":"ContainerStarted","Data":"b4470531f08f4d392cc14218223e15639c53855554256454c7a63c36fc7bb6cc"}
Sep 08 16:31:16.189796 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.189749    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8" event={"ID":"7e32abf4-3a35-4ea2-a571-731885501900","Type":"ContainerStarted","Data":"7e5114da0491a2915e7e8ceef1ec3c1ba415775333f2b47eeaad0afb36d424ba"}
Sep 08 16:31:16.189968 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.189810    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8" event={"ID":"7e32abf4-3a35-4ea2-a571-731885501900","Type":"ContainerStarted","Data":"22926616cbf16114605adbb13f22fa89f75b5fef7424fe700d093a03165ac7b2"}
Sep 08 16:31:16.195620 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.195569    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:31:16.195729 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.195709    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-hm59v" event={"ID":"736abb7e-7095-4c23-b845-0d1de077de57","Type":"ContainerStarted","Data":"74bdaf585d3d261571d5f9710399bae3fb8f0f784780b7281ac801d6460f6770"}
Sep 08 16:31:16.196182 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.196126    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:31:16.206088 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.206036    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-zljt7" podStartSLOduration=44.05751215 podStartE2EDuration="47.206021231s" totalImagesPullingTime="3.148509081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:16.204603935 +0000 UTC m=+71.908446970" watchObservedRunningTime="2026-09-08 16:31:16.206021231 +0000 UTC m=+71.909864221"
Sep 08 16:31:16.232916 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.231945    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-hm59v" podStartSLOduration=37.294413965 podStartE2EDuration="47.231920972s" totalImagesPullingTime="9.937507007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:16.231101367 +0000 UTC m=+71.934944368" watchObservedRunningTime="2026-09-08 16:31:16.231920972 +0000 UTC m=+71.935764008"
Sep 08 16:31:16.252482 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.252424    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-tfrmw" podStartSLOduration=44.05283551 podStartE2EDuration="47.252408946s" totalImagesPullingTime="3.199573436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:16.251124686 +0000 UTC m=+71.954967687" watchObservedRunningTime="2026-09-08 16:31:16.252408946 +0000 UTC m=+71.956251983"
Sep 08 16:31:16.280870 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.280442    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-m9pv8" podStartSLOduration=44.099391444 podStartE2EDuration="47.280419873s" totalImagesPullingTime="3.181028429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:16.279983706 +0000 UTC m=+71.983826705" watchObservedRunningTime="2026-09-08 16:31:16.280419873 +0000 UTC m=+71.984262876"
Sep 08 16:31:16.418993 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.418953    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"]
Sep 08 16:31:16.440003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.438292    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"]
Sep 08 16:31:16.440003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.438419    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:16.441367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.441342    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 16:31:16.441599 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.441581    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v8jpt\""
Sep 08 16:31:16.557157 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.557115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jl4p6\" (UID: \"e521574f-831f-4435-ab7a-973e9586eb10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:16.658072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:16.658036    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jl4p6\" (UID: \"e521574f-831f-4435-ab7a-973e9586eb10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:16.658227 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:16.658168    2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 16:31:16.658268 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:16.658244    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates podName:e521574f-831f-4435-ab7a-973e9586eb10 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:17.158222799 +0000 UTC m=+72.862065792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-jl4p6" (UID: "e521574f-831f-4435-ab7a-973e9586eb10") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 16:31:17.162352 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:17.162316    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jl4p6\" (UID: \"e521574f-831f-4435-ab7a-973e9586eb10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:17.162561 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:17.162445    2547 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 16:31:17.162561 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:31:17.162513    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates podName:e521574f-831f-4435-ab7a-973e9586eb10 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:18.162493679 +0000 UTC m=+73.866336656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-jl4p6" (UID: "e521574f-831f-4435-ab7a-973e9586eb10") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 16:31:17.196212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:17.196173    2547 patch_prober.go:28] interesting pod/console-operator-85b454874b-hm59v container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:31:17.196653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:17.196241    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-85b454874b-hm59v" podUID="736abb7e-7095-4c23-b845-0d1de077de57" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.10:8443/readyz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:31:17.958110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:17.958078    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-hm59v"
Sep 08 16:31:18.166442 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.166407    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-q7pvt"]
Sep 08 16:31:18.172479 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.172450    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jl4p6\" (UID: \"e521574f-831f-4435-ab7a-973e9586eb10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:18.179429 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.179366    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e521574f-831f-4435-ab7a-973e9586eb10-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-jl4p6\" (UID: \"e521574f-831f-4435-ab7a-973e9586eb10\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:18.200017 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.199975    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-q7pvt"]
Sep 08 16:31:18.200398 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.200120    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:18.205914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.205887    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 16:31:18.205914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.205907    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 16:31:18.206112 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.205991    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fr2t8\""
Sep 08 16:31:18.250897 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.250855    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:18.273226 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.273199    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wfp\" (UniqueName: \"kubernetes.io/projected/15884538-8cdf-4bfe-83a3-2161bf92b896-kube-api-access-l5wfp\") pod \"downloads-85d98c998f-q7pvt\" (UID: \"15884538-8cdf-4bfe-83a3-2161bf92b896\") " pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:18.373970 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.373932    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wfp\" (UniqueName: \"kubernetes.io/projected/15884538-8cdf-4bfe-83a3-2161bf92b896-kube-api-access-l5wfp\") pod \"downloads-85d98c998f-q7pvt\" (UID: \"15884538-8cdf-4bfe-83a3-2161bf92b896\") " pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:18.383484 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.383460    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wfp\" (UniqueName: \"kubernetes.io/projected/15884538-8cdf-4bfe-83a3-2161bf92b896-kube-api-access-l5wfp\") pod \"downloads-85d98c998f-q7pvt\" (UID: \"15884538-8cdf-4bfe-83a3-2161bf92b896\") " pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:18.512757 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.512682    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:18.888475 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.888440    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"]
Sep 08 16:31:18.891340 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:18.891311    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode521574f_831f_4435_ab7a_973e9586eb10.slice/crio-f9d97fbfe7fb31488a510d33c6d1f7628e948c30fcc012315a4b3876f4b9688d WatchSource:0}: Error finding container f9d97fbfe7fb31488a510d33c6d1f7628e948c30fcc012315a4b3876f4b9688d: Status 404 returned error can't find the container with id f9d97fbfe7fb31488a510d33c6d1f7628e948c30fcc012315a4b3876f4b9688d
Sep 08 16:31:18.894199 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:18.894096    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-q7pvt"]
Sep 08 16:31:18.897309 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:18.897286    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15884538_8cdf_4bfe_83a3_2161bf92b896.slice/crio-4c183fcda3f9fe1ddcb5b8cffbc4e4fb6bfd65884c0cfcfe268796b992d8788e WatchSource:0}: Error finding container 4c183fcda3f9fe1ddcb5b8cffbc4e4fb6bfd65884c0cfcfe268796b992d8788e: Status 404 returned error can't find the container with id 4c183fcda3f9fe1ddcb5b8cffbc4e4fb6bfd65884c0cfcfe268796b992d8788e
Sep 08 16:31:19.210244 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.210161    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6" event={"ID":"e521574f-831f-4435-ab7a-973e9586eb10","Type":"ContainerStarted","Data":"f9d97fbfe7fb31488a510d33c6d1f7628e948c30fcc012315a4b3876f4b9688d"}
Sep 08 16:31:19.211402 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.211379    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-q7pvt" event={"ID":"15884538-8cdf-4bfe-83a3-2161bf92b896","Type":"ContainerStarted","Data":"4c183fcda3f9fe1ddcb5b8cffbc4e4fb6bfd65884c0cfcfe268796b992d8788e"}
Sep 08 16:31:19.212922 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.212898    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qkf2f" event={"ID":"b8c71dfb-970d-456f-9524-ed93a7904850","Type":"ContainerStarted","Data":"5feea6ec3cf73bd41a279e527dfda0544ba80205c19b680ce608c296eeeed3df"}
Sep 08 16:31:19.214610 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.214591    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b24bq" event={"ID":"37b10fba-cd73-4823-a265-170d76851a3f","Type":"ContainerStarted","Data":"c371aa0c3dd03b00cd14adca3263c942fead3315059019156d0cea295848369f"}
Sep 08 16:31:19.214692 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.214625    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b24bq" event={"ID":"37b10fba-cd73-4823-a265-170d76851a3f","Type":"ContainerStarted","Data":"5790e351b3d86aaab0740c555537cb5c93da67b28305f5856080dcc0dd4feeea"}
Sep 08 16:31:19.214752 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.214733    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b24bq"
Sep 08 16:31:19.233337 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.233288    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qkf2f" podStartSLOduration=65.730942857 podStartE2EDuration="1m13.233271364s" totalImagesPullingTime="7.502328507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:19.232080236 +0000 UTC m=+74.935923236" watchObservedRunningTime="2026-09-08 16:31:19.233271364 +0000 UTC m=+74.937114364"
Sep 08 16:31:19.255470 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:19.255417    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b24bq" podStartSLOduration=33.273473858 podStartE2EDuration="39.255403099s" totalImagesPullingTime="5.981929241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:19.253210514 +0000 UTC m=+74.957053516" watchObservedRunningTime="2026-09-08 16:31:19.255403099 +0000 UTC m=+74.959246101"
Sep 08 16:31:21.225331 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:21.225294    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6" event={"ID":"e521574f-831f-4435-ab7a-973e9586eb10","Type":"ContainerStarted","Data":"a2f196f5b7249d7c22b650c829240ffde2b2dbf8da7d609d83cf74eb8b1e97a3"}
Sep 08 16:31:21.225765 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:21.225530    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:21.231244 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:21.231217    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6"
Sep 08 16:31:21.261148 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:21.261093    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-jl4p6" podStartSLOduration=3.606368331 podStartE2EDuration="5.261078932s" totalImagesPullingTime="1.654710601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:21.243179046 +0000 UTC m=+76.947022045" watchObservedRunningTime="2026-09-08 16:31:21.261078932 +0000 UTC m=+76.964921931"
Sep 08 16:31:27.946882 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.946741    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7g8ph"]
Sep 08 16:31:27.951171 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.951148    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:27.956251 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.956227    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 16:31:27.956494 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.956444    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 16:31:27.956625 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.956609    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 16:31:27.956848 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.956827    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 16:31:27.956960 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:27.956827    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lhmx8\""
Sep 08 16:31:28.054050 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054017    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054223 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054064    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-sys\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054223 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054083    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-tls\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054223 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054131    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-root\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054223 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054157    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-textfile\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054223 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054187    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-wtmp\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054415 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054250    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c5cda6-7c43-400d-ac5c-e584c633f3fd-metrics-client-ca\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054415 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054276    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.054415 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.054298    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swfk9\" (UniqueName: \"kubernetes.io/projected/03c5cda6-7c43-400d-ac5c-e584c633f3fd-kube-api-access-swfk9\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155104 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155073    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c5cda6-7c43-400d-ac5c-e584c633f3fd-metrics-client-ca\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155111    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155137    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swfk9\" (UniqueName: \"kubernetes.io/projected/03c5cda6-7c43-400d-ac5c-e584c633f3fd-kube-api-access-swfk9\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155172    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155212    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-sys\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155231    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-tls\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155259    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-root\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155279    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-textfile\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155644 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155300    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-wtmp\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155644 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-wtmp\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155644 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155640    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155821 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155734    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03c5cda6-7c43-400d-ac5c-e584c633f3fd-metrics-client-ca\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155888 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155827    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-sys\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.155888 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.155833    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03c5cda6-7c43-400d-ac5c-e584c633f3fd-root\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.156238 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.156216    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-textfile\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.158289 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.158182    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.158635 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.158614    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03c5cda6-7c43-400d-ac5c-e584c633f3fd-node-exporter-tls\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.165668 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.165644    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swfk9\" (UniqueName: \"kubernetes.io/projected/03c5cda6-7c43-400d-ac5c-e584c633f3fd-kube-api-access-swfk9\") pod \"node-exporter-7g8ph\" (UID: \"03c5cda6-7c43-400d-ac5c-e584c633f3fd\") " pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.262653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:28.262567    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7g8ph"
Sep 08 16:31:28.276898 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:31:28.276863    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c5cda6_7c43_400d_ac5c_e584c633f3fd.slice/crio-ffd11e0b493d36380f592b6f04e44cc45bb9103f08b421c198c1b8e870ceb057 WatchSource:0}: Error finding container ffd11e0b493d36380f592b6f04e44cc45bb9103f08b421c198c1b8e870ceb057: Status 404 returned error can't find the container with id ffd11e0b493d36380f592b6f04e44cc45bb9103f08b421c198c1b8e870ceb057
Sep 08 16:31:29.222003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:29.221969    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b24bq"
Sep 08 16:31:29.262653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:29.262620    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7g8ph" event={"ID":"03c5cda6-7c43-400d-ac5c-e584c633f3fd","Type":"ContainerStarted","Data":"ffd11e0b493d36380f592b6f04e44cc45bb9103f08b421c198c1b8e870ceb057"}
Sep 08 16:31:34.175814 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:34.175767    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:31:36.298496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:36.295837    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-q7pvt" event={"ID":"15884538-8cdf-4bfe-83a3-2161bf92b896","Type":"ContainerStarted","Data":"6212b86f2ab8376ec27ad51ee1e3e455a831499c41f6412041e8e83a26d09c9e"}
Sep 08 16:31:36.298496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:36.296843    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:36.314235 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:36.314191    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-q7pvt"
Sep 08 16:31:36.315395 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:36.315343    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-q7pvt" podStartSLOduration=1.320366063 podStartE2EDuration="18.315324886s" totalImagesPullingTime="16.994958823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:36.315122315 +0000 UTC m=+92.018965317" watchObservedRunningTime="2026-09-08 16:31:36.315324886 +0000 UTC m=+92.019167893"
Sep 08 16:31:36.685701 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:36.685672    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d475cd58f-fzv6w"]
Sep 08 16:31:37.303151 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:37.303115    2547 generic.go:356] "Generic (PLEG): container finished" podID="03c5cda6-7c43-400d-ac5c-e584c633f3fd" containerID="f30b068762c3a9bd40c97dad858ca6776de6da78bfbea924246f07c465dad50a" exitCode=0
Sep 08 16:31:37.303601 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:37.303210    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7g8ph" event={"ID":"03c5cda6-7c43-400d-ac5c-e584c633f3fd","Type":"ContainerDied","Data":"f30b068762c3a9bd40c97dad858ca6776de6da78bfbea924246f07c465dad50a"}
Sep 08 16:31:38.311126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:38.311080    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7g8ph" event={"ID":"03c5cda6-7c43-400d-ac5c-e584c633f3fd","Type":"ContainerStarted","Data":"abfd51273f3bc9ae8bbe859a580e37dcdef6778a9ab0722a56209d1cff93ad12"}
Sep 08 16:31:38.311559 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:38.311150    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7g8ph" event={"ID":"03c5cda6-7c43-400d-ac5c-e584c633f3fd","Type":"ContainerStarted","Data":"e2c955988ec0054a4e5e66791d65f515412374ba93fdf8f626e0979cea0a7775"}
Sep 08 16:31:38.333851 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:38.333771    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7g8ph" podStartSLOduration=2.850219418 podStartE2EDuration="11.333748159s" totalImagesPullingTime="8.401151447s" totalInitContainerRuntime="82.377294ms" isStatefulPod=true podCreationTimestamp="2026-09-08 16:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:38.332625876 +0000 UTC m=+94.036469110" watchObservedRunningTime="2026-09-08 16:31:38.333748159 +0000 UTC m=+94.037591159"
Sep 08 16:31:43.169366 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:31:43.169332    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ls2d6"
Sep 08 16:32:01.716546 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:01.716503    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w" podUID="d4f96a09-2c50-452e-acfb-2b9a39825902" containerName="registry" containerID="cri-o://c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450" gracePeriod=30
Sep 08 16:32:01.997251 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:01.997179    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:32:02.122535 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122502    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4f96a09-2c50-452e-acfb-2b9a39825902-ca-trust-extracted\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122535 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122538    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122751 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122563    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-certificates\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122751 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122588    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-bound-sa-token\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122751 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122724    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zdgq\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-kube-api-access-6zdgq\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122919 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122818    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-trusted-ca\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122919 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122873    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-installation-pull-secrets\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.122919 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.122906    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-image-registry-private-configuration\") pod \"d4f96a09-2c50-452e-acfb-2b9a39825902\" (UID: \"d4f96a09-2c50-452e-acfb-2b9a39825902\") "
Sep 08 16:32:02.123313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.123163    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:02.123313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.123262    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:02.125375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.125339    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:02.125531 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.125431    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:02.125599 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.125534    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-kube-api-access-6zdgq" (OuterVolumeSpecName: "kube-api-access-6zdgq") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "kube-api-access-6zdgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:02.125662 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.125633    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:02.125860 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.125834    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:02.131655 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.131627    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4f96a09-2c50-452e-acfb-2b9a39825902-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d4f96a09-2c50-452e-acfb-2b9a39825902" (UID: "d4f96a09-2c50-452e-acfb-2b9a39825902"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:32:02.224049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224019    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-installation-pull-secrets\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224045    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4f96a09-2c50-452e-acfb-2b9a39825902-image-registry-private-configuration\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224055    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4f96a09-2c50-452e-acfb-2b9a39825902-ca-trust-extracted\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224064    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224074    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-registry-certificates\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224082    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-bound-sa-token\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224090    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zdgq\" (UniqueName: \"kubernetes.io/projected/d4f96a09-2c50-452e-acfb-2b9a39825902-kube-api-access-6zdgq\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.224257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.224098    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4f96a09-2c50-452e-acfb-2b9a39825902-trusted-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.411472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.411435    2547 generic.go:356] "Generic (PLEG): container finished" podID="d4f96a09-2c50-452e-acfb-2b9a39825902" containerID="c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450" exitCode=0
Sep 08 16:32:02.411674 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.411505    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w"
Sep 08 16:32:02.411674 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.411527    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w" event={"ID":"d4f96a09-2c50-452e-acfb-2b9a39825902","Type":"ContainerDied","Data":"c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450"}
Sep 08 16:32:02.411674 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.411598    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d475cd58f-fzv6w" event={"ID":"d4f96a09-2c50-452e-acfb-2b9a39825902","Type":"ContainerDied","Data":"c115cd42a3f0fb973ced35c6ff205580e542bc50088cc44756392bde6dc3decc"}
Sep 08 16:32:02.411674 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.411624    2547 scope.go:117] "RemoveContainer" containerID="c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450"
Sep 08 16:32:02.413395 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.413372    2547 generic.go:356] "Generic (PLEG): container finished" podID="f0f3a578-c2f9-424c-82ec-51cf40f8450b" containerID="4d4bfa68e06e49ec54b9ce9615f98fefde0283fbb0f12e61e023912a76e37c20" exitCode=0
Sep 08 16:32:02.413522 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.413448    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4" event={"ID":"f0f3a578-c2f9-424c-82ec-51cf40f8450b","Type":"ContainerDied","Data":"4d4bfa68e06e49ec54b9ce9615f98fefde0283fbb0f12e61e023912a76e37c20"}
Sep 08 16:32:02.413747 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.413732    2547 scope.go:117] "RemoveContainer" containerID="4d4bfa68e06e49ec54b9ce9615f98fefde0283fbb0f12e61e023912a76e37c20"
Sep 08 16:32:02.420734 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.420715    2547 scope.go:117] "RemoveContainer" containerID="c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450"
Sep 08 16:32:02.421079 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:32:02.421055    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450\": container with ID starting with c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450 not found: ID does not exist" containerID="c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450"
Sep 08 16:32:02.421133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.421089    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450"} err="failed to get container status \"c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450\": rpc error: code = NotFound desc = could not find container \"c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450\": container with ID starting with c2c9a77f58623c85db68c7fb046d34864d2b96993fa3836bf92d311fe20d8450 not found: ID does not exist"
Sep 08 16:32:02.450580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.450542    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d475cd58f-fzv6w"]
Sep 08 16:32:02.457854 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.457823    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d475cd58f-fzv6w"]
Sep 08 16:32:02.832259 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:02.832225    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4f96a09-2c50-452e-acfb-2b9a39825902" path="/var/lib/kubelet/pods/d4f96a09-2c50-452e-acfb-2b9a39825902/volumes"
Sep 08 16:32:03.418776 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:03.418737    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-7vvg4" event={"ID":"f0f3a578-c2f9-424c-82ec-51cf40f8450b","Type":"ContainerStarted","Data":"4ec6ba36f1ba8ab8f78c045de9f85f7a7190d6b4a6c1b88084b6c6ac238f641a"}
Sep 08 16:32:07.434353 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:07.434321    2547 generic.go:356] "Generic (PLEG): container finished" podID="6ce3e03d-cc35-4f23-b7cf-209b3abb5edc" containerID="edc0bad6b22d285faed5fadaea6108b35ca1a4027dd862d82665cf6686963b96" exitCode=0
Sep 08 16:32:07.434754 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:07.434400    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv" event={"ID":"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc","Type":"ContainerDied","Data":"edc0bad6b22d285faed5fadaea6108b35ca1a4027dd862d82665cf6686963b96"}
Sep 08 16:32:07.434754 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:07.434740    2547 scope.go:117] "RemoveContainer" containerID="edc0bad6b22d285faed5fadaea6108b35ca1a4027dd862d82665cf6686963b96"
Sep 08 16:32:07.435983 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:07.435963    2547 generic.go:356] "Generic (PLEG): container finished" podID="3339a813-1197-4748-b594-af4a7bbfdf87" containerID="1834ed630126bf5efd2b2daacd4d237d233271e2f1593e4da73401aed8049add" exitCode=0
Sep 08 16:32:07.436072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:07.435990    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz" event={"ID":"3339a813-1197-4748-b594-af4a7bbfdf87","Type":"ContainerDied","Data":"1834ed630126bf5efd2b2daacd4d237d233271e2f1593e4da73401aed8049add"}
Sep 08 16:32:07.436234 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:07.436222    2547 scope.go:117] "RemoveContainer" containerID="1834ed630126bf5efd2b2daacd4d237d233271e2f1593e4da73401aed8049add"
Sep 08 16:32:08.443462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:08.443424    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-n5dsv" event={"ID":"6ce3e03d-cc35-4f23-b7cf-209b3abb5edc","Type":"ContainerStarted","Data":"0a06b6544ffff46d21946905f2c7b0f1f2eec326c4b145c6d486fa665e7af223"}
Sep 08 16:32:08.445582 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:08.445556    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-qc9bz" event={"ID":"3339a813-1197-4748-b594-af4a7bbfdf87","Type":"ContainerStarted","Data":"7287ecfd62d9f21da491ff96780858217967035bdfbdd6b9e3e24cbb706f56e5"}
Sep 08 16:32:52.374028 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.373994    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"]
Sep 08 16:32:52.374462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.374263    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4f96a09-2c50-452e-acfb-2b9a39825902" containerName="registry"
Sep 08 16:32:52.374462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.374273    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4f96a09-2c50-452e-acfb-2b9a39825902" containerName="registry"
Sep 08 16:32:52.374462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.374322    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4f96a09-2c50-452e-acfb-2b9a39825902" containerName="registry"
Sep 08 16:32:52.378485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.378465    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.381461 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.381440    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 16:32:52.382615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.382591    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 16:32:52.382727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.382678    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 16:32:52.385640 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.385623    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 16:32:52.386273 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.386256    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 16:32:52.386585 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.386568    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-8jdjb\""
Sep 08 16:32:52.389632 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.389613    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 16:32:52.394965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.394944    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"]
Sep 08 16:32:52.414756 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414723    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-serving-certs-ca-bundle\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.414916 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414773    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pfft\" (UniqueName: \"kubernetes.io/projected/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-kube-api-access-6pfft\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.414916 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414840    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.414916 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414870    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-federate-client-tls\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.414916 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414887    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-metrics-client-ca\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.414916 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414901    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.415090 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414930    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-secret-telemeter-client\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.415090 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.414951    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-telemeter-client-tls\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516067 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516028    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pfft\" (UniqueName: \"kubernetes.io/projected/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-kube-api-access-6pfft\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516067 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516064    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516089    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-federate-client-tls\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516107    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-metrics-client-ca\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516124    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516152    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-secret-telemeter-client\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516186    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-telemeter-client-tls\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.516322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.516208    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-serving-certs-ca-bundle\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.517068 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.517044    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-serving-certs-ca-bundle\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.517432 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.517073    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.517521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.517114    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-metrics-client-ca\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.519074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.519055    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.519152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.519060    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-secret-telemeter-client\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.519202 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.519174    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-federate-client-tls\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.519236 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.519208    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-telemeter-client-tls\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.524430 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.524412    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pfft\" (UniqueName: \"kubernetes.io/projected/916a2fd1-f969-4bcc-b25c-3867c7d1e1e1-kube-api-access-6pfft\") pod \"telemeter-client-6bd5bd998-bwdcp\" (UID: \"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1\") " pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.687967 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.687870    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"
Sep 08 16:32:52.977556 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:52.977478    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6bd5bd998-bwdcp"]
Sep 08 16:32:52.982462 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:32:52.982434    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916a2fd1_f969_4bcc_b25c_3867c7d1e1e1.slice/crio-0fa1fccd56218a24116ed0e14750f03337cb334f0eb4b8fd7a17e9f52e656d1b WatchSource:0}: Error finding container 0fa1fccd56218a24116ed0e14750f03337cb334f0eb4b8fd7a17e9f52e656d1b: Status 404 returned error can't find the container with id 0fa1fccd56218a24116ed0e14750f03337cb334f0eb4b8fd7a17e9f52e656d1b
Sep 08 16:32:53.615841 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:53.615800    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp" event={"ID":"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1","Type":"ContainerStarted","Data":"0fa1fccd56218a24116ed0e14750f03337cb334f0eb4b8fd7a17e9f52e656d1b"}
Sep 08 16:32:55.626856 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:55.626819    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp" event={"ID":"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1","Type":"ContainerStarted","Data":"6a2c25db5e81997a9707df84cb0cc2bec3be8d9fd39e3625647b224a32905568"}
Sep 08 16:32:56.633127 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:56.633032    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp" event={"ID":"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1","Type":"ContainerStarted","Data":"2af92b147176dc5fe2e6d1bf844a0c2e6c553d5f7ccfb28b898a5e1ccd8e996b"}
Sep 08 16:32:56.633127 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:56.633088    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp" event={"ID":"916a2fd1-f969-4bcc-b25c-3867c7d1e1e1","Type":"ContainerStarted","Data":"b6c1b0726921bcfba8b7da7b4c2b5cb004bad872b6140d5700ea0e660b3bb9d6"}
Sep 08 16:32:56.663318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:32:56.663258    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6bd5bd998-bwdcp" podStartSLOduration=1.366278283 podStartE2EDuration="4.663238891s" totalImagesPullingTime="3.296960608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:32:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:32:56.660056027 +0000 UTC m=+172.363899025" watchObservedRunningTime="2026-09-08 16:32:56.663238891 +0000 UTC m=+172.367081893"
Sep 08 16:35:04.726764 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:04.726734    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:35:04.729345 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:04.729324    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:35:04.738736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:04.738711    2547 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 16:35:28.831742 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.831713    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"]
Sep 08 16:35:28.834889 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.834874    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:28.837343 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.837319    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:35:28.838133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.838119    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:35:28.838193 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.838123    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4ll5\""
Sep 08 16:35:28.845128 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.845101    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"]
Sep 08 16:35:28.973499 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.973460    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkx2w\" (UniqueName: \"kubernetes.io/projected/e9b16277-96c8-45d2-aae7-1fc4d0522415-kube-api-access-hkx2w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:28.973676 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.973517    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:28.973676 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:28.973632    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.074585 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.074553    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkx2w\" (UniqueName: \"kubernetes.io/projected/e9b16277-96c8-45d2-aae7-1fc4d0522415-kube-api-access-hkx2w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.074776 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.074605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.074776 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.074670    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.075113 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.075091    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.075181 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.075113    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.084304 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.084248    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkx2w\" (UniqueName: \"kubernetes.io/projected/e9b16277-96c8-45d2-aae7-1fc4d0522415-kube-api-access-hkx2w\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.145837 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.145769    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:29.414897 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.414872    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"]
Sep 08 16:35:29.417283 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:35:29.417252    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b16277_96c8_45d2_aae7_1fc4d0522415.slice/crio-e5a4048f018f6264150def0d6f21a52c8da7071b80cd3e8f0ca206edc9ce2ce8 WatchSource:0}: Error finding container e5a4048f018f6264150def0d6f21a52c8da7071b80cd3e8f0ca206edc9ce2ce8: Status 404 returned error can't find the container with id e5a4048f018f6264150def0d6f21a52c8da7071b80cd3e8f0ca206edc9ce2ce8
Sep 08 16:35:29.419168 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:29.419152    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:35:30.208580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:30.208542    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px" event={"ID":"e9b16277-96c8-45d2-aae7-1fc4d0522415","Type":"ContainerStarted","Data":"e5a4048f018f6264150def0d6f21a52c8da7071b80cd3e8f0ca206edc9ce2ce8"}
Sep 08 16:35:36.235689 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:36.235660    2547 generic.go:356] "Generic (PLEG): container finished" podID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerID="7d2a4d885b6ade1d00eb2fb0fa4474d6f64871e3978c6aa0b9a5b4014e3fe4cd" exitCode=0
Sep 08 16:35:36.236152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:36.235741    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px" event={"ID":"e9b16277-96c8-45d2-aae7-1fc4d0522415","Type":"ContainerDied","Data":"7d2a4d885b6ade1d00eb2fb0fa4474d6f64871e3978c6aa0b9a5b4014e3fe4cd"}
Sep 08 16:35:39.251362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:39.251327    2547 generic.go:356] "Generic (PLEG): container finished" podID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerID="6aa486dfee31532f6e6bdb5f8425dbb987738718148ed2ac0aa313b1d174c4b7" exitCode=0
Sep 08 16:35:39.251720 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:39.251383    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px" event={"ID":"e9b16277-96c8-45d2-aae7-1fc4d0522415","Type":"ContainerDied","Data":"6aa486dfee31532f6e6bdb5f8425dbb987738718148ed2ac0aa313b1d174c4b7"}
Sep 08 16:35:48.288000 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:48.287964    2547 generic.go:356] "Generic (PLEG): container finished" podID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerID="7f2d34a9fce00cbb7bd63ab84ccdcd26a0842655a0f9bcb57fed35e987be0d89" exitCode=0
Sep 08 16:35:48.288357 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:48.288006    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px" event={"ID":"e9b16277-96c8-45d2-aae7-1fc4d0522415","Type":"ContainerDied","Data":"7f2d34a9fce00cbb7bd63ab84ccdcd26a0842655a0f9bcb57fed35e987be0d89"}
Sep 08 16:35:49.421693 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.421669    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:49.544316 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.544237    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkx2w\" (UniqueName: \"kubernetes.io/projected/e9b16277-96c8-45d2-aae7-1fc4d0522415-kube-api-access-hkx2w\") pod \"e9b16277-96c8-45d2-aae7-1fc4d0522415\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") "
Sep 08 16:35:49.544316 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.544297    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-bundle\") pod \"e9b16277-96c8-45d2-aae7-1fc4d0522415\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") "
Sep 08 16:35:49.544512 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.544325    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-util\") pod \"e9b16277-96c8-45d2-aae7-1fc4d0522415\" (UID: \"e9b16277-96c8-45d2-aae7-1fc4d0522415\") "
Sep 08 16:35:49.545161 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.545133    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-bundle" (OuterVolumeSpecName: "bundle") pod "e9b16277-96c8-45d2-aae7-1fc4d0522415" (UID: "e9b16277-96c8-45d2-aae7-1fc4d0522415"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.546617 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.546595    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9b16277-96c8-45d2-aae7-1fc4d0522415-kube-api-access-hkx2w" (OuterVolumeSpecName: "kube-api-access-hkx2w") pod "e9b16277-96c8-45d2-aae7-1fc4d0522415" (UID: "e9b16277-96c8-45d2-aae7-1fc4d0522415"). InnerVolumeSpecName "kube-api-access-hkx2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:35:49.549475 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.549450    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-util" (OuterVolumeSpecName: "util") pod "e9b16277-96c8-45d2-aae7-1fc4d0522415" (UID: "e9b16277-96c8-45d2-aae7-1fc4d0522415"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:35:49.645865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.645829    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkx2w\" (UniqueName: \"kubernetes.io/projected/e9b16277-96c8-45d2-aae7-1fc4d0522415-kube-api-access-hkx2w\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.645865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.645858    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:35:49.645865 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:49.645870    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e9b16277-96c8-45d2-aae7-1fc4d0522415-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:35:50.297608 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:50.297569    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px" event={"ID":"e9b16277-96c8-45d2-aae7-1fc4d0522415","Type":"ContainerDied","Data":"e5a4048f018f6264150def0d6f21a52c8da7071b80cd3e8f0ca206edc9ce2ce8"}
Sep 08 16:35:50.297766 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:50.297622    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a4048f018f6264150def0d6f21a52c8da7071b80cd3e8f0ca206edc9ce2ce8"
Sep 08 16:35:50.297766 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:50.297582    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dd5px"
Sep 08 16:35:56.896551 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896469    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"]
Sep 08 16:35:56.896949 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896884    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="extract"
Sep 08 16:35:56.896949 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896905    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="extract"
Sep 08 16:35:56.896949 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896930    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="pull"
Sep 08 16:35:56.896949 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896939    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="pull"
Sep 08 16:35:56.897075 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896957    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="util"
Sep 08 16:35:56.897075 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.896965    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="util"
Sep 08 16:35:56.897075 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.897064    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9b16277-96c8-45d2-aae7-1fc4d0522415" containerName="extract"
Sep 08 16:35:56.900026 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.900009    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:56.902108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.902087    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:35:56.902555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.902538    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 16:35:56.902620 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.902599    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5f25z\""
Sep 08 16:35:56.914152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.914132    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"]
Sep 08 16:35:56.994307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.994269    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56q9z\" (UniqueName: \"kubernetes.io/projected/9ebca23f-9cf5-4e1c-bf0e-24174edeb66e-kube-api-access-56q9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-nskbx\" (UID: \"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:56.994488 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:56.994314    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ebca23f-9cf5-4e1c-bf0e-24174edeb66e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nskbx\" (UID: \"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:57.095208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:57.095175    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56q9z\" (UniqueName: \"kubernetes.io/projected/9ebca23f-9cf5-4e1c-bf0e-24174edeb66e-kube-api-access-56q9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-nskbx\" (UID: \"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:57.095208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:57.095210    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ebca23f-9cf5-4e1c-bf0e-24174edeb66e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nskbx\" (UID: \"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:57.095611 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:57.095594    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ebca23f-9cf5-4e1c-bf0e-24174edeb66e-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-nskbx\" (UID: \"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:57.103452 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:57.103428    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56q9z\" (UniqueName: \"kubernetes.io/projected/9ebca23f-9cf5-4e1c-bf0e-24174edeb66e-kube-api-access-56q9z\") pod \"cert-manager-operator-controller-manager-55c444bf86-nskbx\" (UID: \"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:57.208664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:57.208591    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"
Sep 08 16:35:57.482409 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:57.482320    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx"]
Sep 08 16:35:57.486402 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:35:57.486367    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebca23f_9cf5_4e1c_bf0e_24174edeb66e.slice/crio-ac3e7744b2589c04f79a669d5e39f3b61a6e65fc6c7b13ee92e9bc7ebe242e05 WatchSource:0}: Error finding container ac3e7744b2589c04f79a669d5e39f3b61a6e65fc6c7b13ee92e9bc7ebe242e05: Status 404 returned error can't find the container with id ac3e7744b2589c04f79a669d5e39f3b61a6e65fc6c7b13ee92e9bc7ebe242e05
Sep 08 16:35:58.330150 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:35:58.330116    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx" event={"ID":"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e","Type":"ContainerStarted","Data":"ac3e7744b2589c04f79a669d5e39f3b61a6e65fc6c7b13ee92e9bc7ebe242e05"}
Sep 08 16:36:00.346064 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:00.345969    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx" event={"ID":"9ebca23f-9cf5-4e1c-bf0e-24174edeb66e","Type":"ContainerStarted","Data":"5b35054d98a0a0eee432b53da7779aec81d6174822ae73ab5b64b3be5458f079"}
Sep 08 16:36:00.364502 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:00.364455    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-nskbx" podStartSLOduration=1.985333266 podStartE2EDuration="4.364441337s" totalImagesPullingTime="2.379108071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:00.362679197 +0000 UTC m=+356.066522198" watchObservedRunningTime="2026-09-08 16:36:00.364441337 +0000 UTC m=+356.068284338"
Sep 08 16:36:01.308111 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.308077    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"]
Sep 08 16:36:01.311572 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.311556    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.313876 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.313849    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:36:01.314411 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.314395    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:36:01.314478 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.314411    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4ll5\""
Sep 08 16:36:01.319278 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.319255    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"]
Sep 08 16:36:01.326370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.326352    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.326450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.326377    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxdv8\" (UniqueName: \"kubernetes.io/projected/dd97d785-be04-4b2f-aba5-faee3edc64ec-kube-api-access-rxdv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.326450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.326406    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.427686 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.427655    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.428058 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.427694    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxdv8\" (UniqueName: \"kubernetes.io/projected/dd97d785-be04-4b2f-aba5-faee3edc64ec-kube-api-access-rxdv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.428058 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.427738    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.428058 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.428018    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.428165 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.428074    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.437624 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.437601    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxdv8\" (UniqueName: \"kubernetes.io/projected/dd97d785-be04-4b2f-aba5-faee3edc64ec-kube-api-access-rxdv8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.621398 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.621307    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:01.891748 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:01.891725    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"]
Sep 08 16:36:01.894126 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:01.894100    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd97d785_be04_4b2f_aba5_faee3edc64ec.slice/crio-a6e4bd7d4434d004dc974b76b277aacea1ec084c3ee9b4c865a9c93d15e618e8 WatchSource:0}: Error finding container a6e4bd7d4434d004dc974b76b277aacea1ec084c3ee9b4c865a9c93d15e618e8: Status 404 returned error can't find the container with id a6e4bd7d4434d004dc974b76b277aacea1ec084c3ee9b4c865a9c93d15e618e8
Sep 08 16:36:02.355721 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:02.355683    2547 generic.go:356] "Generic (PLEG): container finished" podID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerID="ff848e1f89542bd75d1c0c16d2379baeb29c37c5e50c460b67b84f44d3290f87" exitCode=0
Sep 08 16:36:02.355938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:02.355770    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf" event={"ID":"dd97d785-be04-4b2f-aba5-faee3edc64ec","Type":"ContainerDied","Data":"ff848e1f89542bd75d1c0c16d2379baeb29c37c5e50c460b67b84f44d3290f87"}
Sep 08 16:36:02.355938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:02.355835    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf" event={"ID":"dd97d785-be04-4b2f-aba5-faee3edc64ec","Type":"ContainerStarted","Data":"a6e4bd7d4434d004dc974b76b277aacea1ec084c3ee9b4c865a9c93d15e618e8"}
Sep 08 16:36:10.393580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:10.393545    2547 generic.go:356] "Generic (PLEG): container finished" podID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerID="a4cca516657020c98750f2c60419cc4bfdd09488f56deac915e09218103b6434" exitCode=0
Sep 08 16:36:10.394112 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:10.393635    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf" event={"ID":"dd97d785-be04-4b2f-aba5-faee3edc64ec","Type":"ContainerDied","Data":"a4cca516657020c98750f2c60419cc4bfdd09488f56deac915e09218103b6434"}
Sep 08 16:36:11.399694 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:11.399658    2547 generic.go:356] "Generic (PLEG): container finished" podID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerID="c2b6b383bd6e88d508979a03371742a4f1fd1fa772f27b7ddd7476ffca8bf8e2" exitCode=0
Sep 08 16:36:11.400075 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:11.399746    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf" event={"ID":"dd97d785-be04-4b2f-aba5-faee3edc64ec","Type":"ContainerDied","Data":"c2b6b383bd6e88d508979a03371742a4f1fd1fa772f27b7ddd7476ffca8bf8e2"}
Sep 08 16:36:12.525170 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.525148    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:12.610235 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.610204    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxdv8\" (UniqueName: \"kubernetes.io/projected/dd97d785-be04-4b2f-aba5-faee3edc64ec-kube-api-access-rxdv8\") pod \"dd97d785-be04-4b2f-aba5-faee3edc64ec\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") "
Sep 08 16:36:12.610409 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.610271    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-bundle\") pod \"dd97d785-be04-4b2f-aba5-faee3edc64ec\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") "
Sep 08 16:36:12.610409 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.610312    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-util\") pod \"dd97d785-be04-4b2f-aba5-faee3edc64ec\" (UID: \"dd97d785-be04-4b2f-aba5-faee3edc64ec\") "
Sep 08 16:36:12.610640 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.610615    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-bundle" (OuterVolumeSpecName: "bundle") pod "dd97d785-be04-4b2f-aba5-faee3edc64ec" (UID: "dd97d785-be04-4b2f-aba5-faee3edc64ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:12.612432 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.612411    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd97d785-be04-4b2f-aba5-faee3edc64ec-kube-api-access-rxdv8" (OuterVolumeSpecName: "kube-api-access-rxdv8") pod "dd97d785-be04-4b2f-aba5-faee3edc64ec" (UID: "dd97d785-be04-4b2f-aba5-faee3edc64ec"). InnerVolumeSpecName "kube-api-access-rxdv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:12.614831 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.614811    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-util" (OuterVolumeSpecName: "util") pod "dd97d785-be04-4b2f-aba5-faee3edc64ec" (UID: "dd97d785-be04-4b2f-aba5-faee3edc64ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:12.711572 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.711476    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxdv8\" (UniqueName: \"kubernetes.io/projected/dd97d785-be04-4b2f-aba5-faee3edc64ec-kube-api-access-rxdv8\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:12.711572 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.711518    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:12.711572 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:12.711527    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97d785-be04-4b2f-aba5-faee3edc64ec-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:13.253545 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253517    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cq8n8"]
Sep 08 16:36:13.253822 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253809    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="pull"
Sep 08 16:36:13.253872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253823    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="pull"
Sep 08 16:36:13.253872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253835    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="util"
Sep 08 16:36:13.253872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253840    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="util"
Sep 08 16:36:13.253872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253851    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="extract"
Sep 08 16:36:13.253872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253856    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="extract"
Sep 08 16:36:13.254013 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.253909    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd97d785-be04-4b2f-aba5-faee3edc64ec" containerName="extract"
Sep 08 16:36:13.257207 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.257188    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.259401 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.259380    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 16:36:13.260281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.260262    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 16:36:13.260378 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.260264    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-nfvdm\""
Sep 08 16:36:13.266923 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.266903    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cq8n8"]
Sep 08 16:36:13.315680 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.315647    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwzkg\" (UniqueName: \"kubernetes.io/projected/7a6eb79a-2356-4a55-89ea-96d4befaa7cb-kube-api-access-zwzkg\") pod \"cert-manager-webhook-6486ffd997-cq8n8\" (UID: \"7a6eb79a-2356-4a55-89ea-96d4befaa7cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.315862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.315689    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a6eb79a-2356-4a55-89ea-96d4befaa7cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cq8n8\" (UID: \"7a6eb79a-2356-4a55-89ea-96d4befaa7cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.410375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.410344    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf"
Sep 08 16:36:13.410375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.410370    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkvctf" event={"ID":"dd97d785-be04-4b2f-aba5-faee3edc64ec","Type":"ContainerDied","Data":"a6e4bd7d4434d004dc974b76b277aacea1ec084c3ee9b4c865a9c93d15e618e8"}
Sep 08 16:36:13.410580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.410434    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a6e4bd7d4434d004dc974b76b277aacea1ec084c3ee9b4c865a9c93d15e618e8"
Sep 08 16:36:13.416449 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.416421    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a6eb79a-2356-4a55-89ea-96d4befaa7cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cq8n8\" (UID: \"7a6eb79a-2356-4a55-89ea-96d4befaa7cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.416557 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.416524    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwzkg\" (UniqueName: \"kubernetes.io/projected/7a6eb79a-2356-4a55-89ea-96d4befaa7cb-kube-api-access-zwzkg\") pod \"cert-manager-webhook-6486ffd997-cq8n8\" (UID: \"7a6eb79a-2356-4a55-89ea-96d4befaa7cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.424504 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.424481    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwzkg\" (UniqueName: \"kubernetes.io/projected/7a6eb79a-2356-4a55-89ea-96d4befaa7cb-kube-api-access-zwzkg\") pod \"cert-manager-webhook-6486ffd997-cq8n8\" (UID: \"7a6eb79a-2356-4a55-89ea-96d4befaa7cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.424612 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.424542    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a6eb79a-2356-4a55-89ea-96d4befaa7cb-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-cq8n8\" (UID: \"7a6eb79a-2356-4a55-89ea-96d4befaa7cb\") " pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.573963 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.573929    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:13.844625 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:13.844604    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-cq8n8"]
Sep 08 16:36:13.847097 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:13.847075    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a6eb79a_2356_4a55_89ea_96d4befaa7cb.slice/crio-37a90f8ec13f8724cd3b20193fdda91312801e3c26ea85b8c52616ec22fd1b39 WatchSource:0}: Error finding container 37a90f8ec13f8724cd3b20193fdda91312801e3c26ea85b8c52616ec22fd1b39: Status 404 returned error can't find the container with id 37a90f8ec13f8724cd3b20193fdda91312801e3c26ea85b8c52616ec22fd1b39
Sep 08 16:36:14.416827 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:14.416770    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8" event={"ID":"7a6eb79a-2356-4a55-89ea-96d4befaa7cb","Type":"ContainerStarted","Data":"37a90f8ec13f8724cd3b20193fdda91312801e3c26ea85b8c52616ec22fd1b39"}
Sep 08 16:36:16.428192 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:16.428152    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8" event={"ID":"7a6eb79a-2356-4a55-89ea-96d4befaa7cb","Type":"ContainerStarted","Data":"50d5e5094bec837de34edb1a2276794dd2a6cb6c638b6f381c6d9d56b8ff0c55"}
Sep 08 16:36:16.428593 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:16.428231    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:16.445847 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:16.445758    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8" podStartSLOduration=1.065832114 podStartE2EDuration="3.445742218s" totalImagesPullingTime="2.379910104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:16.44459381 +0000 UTC m=+372.148436823" watchObservedRunningTime="2026-09-08 16:36:16.445742218 +0000 UTC m=+372.149585217"
Sep 08 16:36:19.124152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.124116    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"]
Sep 08 16:36:19.127353 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.127331    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.132019 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.132000    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:36:19.132634 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.132616    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 16:36:19.132726 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.132624    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-89njh\""
Sep 08 16:36:19.145197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.145173    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"]
Sep 08 16:36:19.162595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.162569    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m44ks\" (UniqueName: \"kubernetes.io/projected/bd683fe1-bebe-4377-8e6b-c4157093baa7-kube-api-access-m44ks\") pod \"openshift-lws-operator-fd8ccff4c-dq2x4\" (UID: \"bd683fe1-bebe-4377-8e6b-c4157093baa7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.162684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.162620    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd683fe1-bebe-4377-8e6b-c4157093baa7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dq2x4\" (UID: \"bd683fe1-bebe-4377-8e6b-c4157093baa7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.264096 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.264050    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m44ks\" (UniqueName: \"kubernetes.io/projected/bd683fe1-bebe-4377-8e6b-c4157093baa7-kube-api-access-m44ks\") pod \"openshift-lws-operator-fd8ccff4c-dq2x4\" (UID: \"bd683fe1-bebe-4377-8e6b-c4157093baa7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.264266 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.264101    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd683fe1-bebe-4377-8e6b-c4157093baa7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dq2x4\" (UID: \"bd683fe1-bebe-4377-8e6b-c4157093baa7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.264451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.264433    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd683fe1-bebe-4377-8e6b-c4157093baa7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dq2x4\" (UID: \"bd683fe1-bebe-4377-8e6b-c4157093baa7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.272885 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.272844    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m44ks\" (UniqueName: \"kubernetes.io/projected/bd683fe1-bebe-4377-8e6b-c4157093baa7-kube-api-access-m44ks\") pod \"openshift-lws-operator-fd8ccff4c-dq2x4\" (UID: \"bd683fe1-bebe-4377-8e6b-c4157093baa7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.435680 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.435598    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"
Sep 08 16:36:19.704899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:19.704865    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4"]
Sep 08 16:36:19.707496 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:19.707475    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd683fe1_bebe_4377_8e6b_c4157093baa7.slice/crio-75be924f2a7368663ae932c60f43ca65bd15e1f341f015676cd02949dd004b1a WatchSource:0}: Error finding container 75be924f2a7368663ae932c60f43ca65bd15e1f341f015676cd02949dd004b1a: Status 404 returned error can't find the container with id 75be924f2a7368663ae932c60f43ca65bd15e1f341f015676cd02949dd004b1a
Sep 08 16:36:20.445649 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:20.445610    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4" event={"ID":"bd683fe1-bebe-4377-8e6b-c4157093baa7","Type":"ContainerStarted","Data":"75be924f2a7368663ae932c60f43ca65bd15e1f341f015676cd02949dd004b1a"}
Sep 08 16:36:22.434914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:22.434881    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-cq8n8"
Sep 08 16:36:23.461452 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:23.461370    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4" event={"ID":"bd683fe1-bebe-4377-8e6b-c4157093baa7","Type":"ContainerStarted","Data":"6ce91531abfa04ae36eaa025177427f29add977c41b1a15859c67101ca0af685"}
Sep 08 16:36:23.476952 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:23.476899    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dq2x4" podStartSLOduration=1.150205646 podStartE2EDuration="4.476882106s" totalImagesPullingTime="3.32667646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:23.475566477 +0000 UTC m=+379.179409478" watchObservedRunningTime="2026-09-08 16:36:23.476882106 +0000 UTC m=+379.180725105"
Sep 08 16:36:26.688280 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.688244    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"]
Sep 08 16:36:26.691556 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.691540    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.694111 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.694092    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4ll5\""
Sep 08 16:36:26.694352 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.694333    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:36:26.694972 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.694957    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:36:26.700513 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.700492    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"]
Sep 08 16:36:26.826240 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.826207    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.826408 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.826254    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.826408 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.826274    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqmm2\" (UniqueName: \"kubernetes.io/projected/6910c492-3022-4ff8-a88b-98a6a610a4fe-kube-api-access-dqmm2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.926807 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.926754    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.926995 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.926815    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqmm2\" (UniqueName: \"kubernetes.io/projected/6910c492-3022-4ff8-a88b-98a6a610a4fe-kube-api-access-dqmm2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.926995 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.926904    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.927160 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.927140    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.927225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.927204    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:26.934740 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:26.934710    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqmm2\" (UniqueName: \"kubernetes.io/projected/6910c492-3022-4ff8-a88b-98a6a610a4fe-kube-api-access-dqmm2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:27.000820 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:27.000738    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:27.271601 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:27.271520    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"]
Sep 08 16:36:27.274740 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:27.274715    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6910c492_3022_4ff8_a88b_98a6a610a4fe.slice/crio-4b837abc8af2cbbeada4d567a7445783105f86605f8955b8f7ece403608bee7c WatchSource:0}: Error finding container 4b837abc8af2cbbeada4d567a7445783105f86605f8955b8f7ece403608bee7c: Status 404 returned error can't find the container with id 4b837abc8af2cbbeada4d567a7445783105f86605f8955b8f7ece403608bee7c
Sep 08 16:36:27.480908 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:27.480869    2547 generic.go:356] "Generic (PLEG): container finished" podID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerID="8733d8df2db703396e4031996a6fac656e5a97ddeecd29b5e1e8e9afb14e608e" exitCode=0
Sep 08 16:36:27.481067 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:27.480940    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd" event={"ID":"6910c492-3022-4ff8-a88b-98a6a610a4fe","Type":"ContainerDied","Data":"8733d8df2db703396e4031996a6fac656e5a97ddeecd29b5e1e8e9afb14e608e"}
Sep 08 16:36:27.481067 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:27.480985    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd" event={"ID":"6910c492-3022-4ff8-a88b-98a6a610a4fe","Type":"ContainerStarted","Data":"4b837abc8af2cbbeada4d567a7445783105f86605f8955b8f7ece403608bee7c"}
Sep 08 16:36:28.486847 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:28.486816    2547 generic.go:356] "Generic (PLEG): container finished" podID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerID="eaa537bce2e91c7bc0b698d3719dd33672c8711a1d2d6a56a445155bce174647" exitCode=0
Sep 08 16:36:28.487207 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:28.486949    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd" event={"ID":"6910c492-3022-4ff8-a88b-98a6a610a4fe","Type":"ContainerDied","Data":"eaa537bce2e91c7bc0b698d3719dd33672c8711a1d2d6a56a445155bce174647"}
Sep 08 16:36:29.493224 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:29.493192    2547 generic.go:356] "Generic (PLEG): container finished" podID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerID="e55b9d4a1cef235b0df471b7b6bd0cc89774ee35ab4817a89422152f7b348808" exitCode=0
Sep 08 16:36:29.493611 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:29.493282    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd" event={"ID":"6910c492-3022-4ff8-a88b-98a6a610a4fe","Type":"ContainerDied","Data":"e55b9d4a1cef235b0df471b7b6bd0cc89774ee35ab4817a89422152f7b348808"}
Sep 08 16:36:30.622834 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.622811    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:30.760548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.760452    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-util\") pod \"6910c492-3022-4ff8-a88b-98a6a610a4fe\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") "
Sep 08 16:36:30.760548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.760533    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-bundle\") pod \"6910c492-3022-4ff8-a88b-98a6a610a4fe\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") "
Sep 08 16:36:30.760818 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.760559    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqmm2\" (UniqueName: \"kubernetes.io/projected/6910c492-3022-4ff8-a88b-98a6a610a4fe-kube-api-access-dqmm2\") pod \"6910c492-3022-4ff8-a88b-98a6a610a4fe\" (UID: \"6910c492-3022-4ff8-a88b-98a6a610a4fe\") "
Sep 08 16:36:30.761360 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.761331    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-bundle" (OuterVolumeSpecName: "bundle") pod "6910c492-3022-4ff8-a88b-98a6a610a4fe" (UID: "6910c492-3022-4ff8-a88b-98a6a610a4fe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:30.762900 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.762870    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6910c492-3022-4ff8-a88b-98a6a610a4fe-kube-api-access-dqmm2" (OuterVolumeSpecName: "kube-api-access-dqmm2") pod "6910c492-3022-4ff8-a88b-98a6a610a4fe" (UID: "6910c492-3022-4ff8-a88b-98a6a610a4fe"). InnerVolumeSpecName "kube-api-access-dqmm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:30.766133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.766108    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-util" (OuterVolumeSpecName: "util") pod "6910c492-3022-4ff8-a88b-98a6a610a4fe" (UID: "6910c492-3022-4ff8-a88b-98a6a610a4fe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:30.862020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.861993    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:30.862020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.862015    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqmm2\" (UniqueName: \"kubernetes.io/projected/6910c492-3022-4ff8-a88b-98a6a610a4fe-kube-api-access-dqmm2\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:30.862020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:30.862025    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6910c492-3022-4ff8-a88b-98a6a610a4fe-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:31.503460 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:31.503419    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd" event={"ID":"6910c492-3022-4ff8-a88b-98a6a610a4fe","Type":"ContainerDied","Data":"4b837abc8af2cbbeada4d567a7445783105f86605f8955b8f7ece403608bee7c"}
Sep 08 16:36:31.503460 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:31.503440    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af2t7kd"
Sep 08 16:36:31.503460 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:31.503463    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b837abc8af2cbbeada4d567a7445783105f86605f8955b8f7ece403608bee7c"
Sep 08 16:36:37.101398 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101365    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"]
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101642    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="extract"
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101652    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="extract"
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101669    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="util"
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101676    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="util"
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101685    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="pull"
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101691    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="pull"
Sep 08 16:36:37.101845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.101741    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6910c492-3022-4ff8-a88b-98a6a610a4fe" containerName="extract"
Sep 08 16:36:37.105963 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.105948    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.108214 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.108188    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:36:37.108946 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.108928    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:36:37.109047 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.108932    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4ll5\""
Sep 08 16:36:37.113425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.113399    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"]
Sep 08 16:36:37.209434 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.209402    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.209618 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.209461    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.209618 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.209518    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf46m\" (UniqueName: \"kubernetes.io/projected/43a450e8-2b03-442e-beb5-ab30e7822b03-kube-api-access-vf46m\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.310322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.310287    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.310530 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.310348    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf46m\" (UniqueName: \"kubernetes.io/projected/43a450e8-2b03-442e-beb5-ab30e7822b03-kube-api-access-vf46m\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.310530 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.310461    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.310762 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.310742    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.310864 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.310766    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.321460 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.321437    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf46m\" (UniqueName: \"kubernetes.io/projected/43a450e8-2b03-442e-beb5-ab30e7822b03-kube-api-access-vf46m\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.417242 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.417153    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:37.692635 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:37.692491    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"]
Sep 08 16:36:37.695463 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:37.695423    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a450e8_2b03_442e_beb5_ab30e7822b03.slice/crio-77cbb81ecf98926789609915734e8e923caa63b59976ef65c5fc9cf8f7ac0887 WatchSource:0}: Error finding container 77cbb81ecf98926789609915734e8e923caa63b59976ef65c5fc9cf8f7ac0887: Status 404 returned error can't find the container with id 77cbb81ecf98926789609915734e8e923caa63b59976ef65c5fc9cf8f7ac0887
Sep 08 16:36:38.536147 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.536109    2547 generic.go:356] "Generic (PLEG): container finished" podID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerID="cdf4664c7d94a1027bb27d66121b1bc97f1c502e935baee138fd2f9201d530f5" exitCode=0
Sep 08 16:36:38.536569 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.536199    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr" event={"ID":"43a450e8-2b03-442e-beb5-ab30e7822b03","Type":"ContainerDied","Data":"cdf4664c7d94a1027bb27d66121b1bc97f1c502e935baee138fd2f9201d530f5"}
Sep 08 16:36:38.536569 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.536257    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr" event={"ID":"43a450e8-2b03-442e-beb5-ab30e7822b03","Type":"ContainerStarted","Data":"77cbb81ecf98926789609915734e8e923caa63b59976ef65c5fc9cf8f7ac0887"}
Sep 08 16:36:38.757924 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.757836    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"]
Sep 08 16:36:38.761003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.760987    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.763230 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.763201    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 16:36:38.763380 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.763365    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 16:36:38.765658 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.765636    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 16:36:38.765761 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.765699    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 16:36:38.765905 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.765892    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dmjj6\""
Sep 08 16:36:38.782673 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.782644    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"]
Sep 08 16:36:38.822221 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.822186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp2tr\" (UniqueName: \"kubernetes.io/projected/138ee252-68d1-4558-b0ad-13833bb4cfa8-kube-api-access-qp2tr\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.822221 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.822222    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/138ee252-68d1-4558-b0ad-13833bb4cfa8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.822412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.822303    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/138ee252-68d1-4558-b0ad-13833bb4cfa8-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.822412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.822356    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138ee252-68d1-4558-b0ad-13833bb4cfa8-tmp\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.822412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.822388    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/138ee252-68d1-4558-b0ad-13833bb4cfa8-manifests\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.923488 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.923456    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/138ee252-68d1-4558-b0ad-13833bb4cfa8-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.923488 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.923493    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138ee252-68d1-4558-b0ad-13833bb4cfa8-tmp\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.923682 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.923520    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/138ee252-68d1-4558-b0ad-13833bb4cfa8-manifests\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.923682 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.923546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp2tr\" (UniqueName: \"kubernetes.io/projected/138ee252-68d1-4558-b0ad-13833bb4cfa8-kube-api-access-qp2tr\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.923750 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.923683    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/138ee252-68d1-4558-b0ad-13833bb4cfa8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.924039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.924009    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/138ee252-68d1-4558-b0ad-13833bb4cfa8-manifests\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.925964 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.925944    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/138ee252-68d1-4558-b0ad-13833bb4cfa8-tmp\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.926164 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.926150    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/138ee252-68d1-4558-b0ad-13833bb4cfa8-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.926308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.926287    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/138ee252-68d1-4558-b0ad-13833bb4cfa8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:38.935217 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:38.935189    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp2tr\" (UniqueName: \"kubernetes.io/projected/138ee252-68d1-4558-b0ad-13833bb4cfa8-kube-api-access-qp2tr\") pod \"opendatahub-operator-controller-manager-86d7bb586f-fqqgd\" (UID: \"138ee252-68d1-4558-b0ad-13833bb4cfa8\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:39.071410 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:39.071359    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:39.347758 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:39.347666    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"]
Sep 08 16:36:39.359764 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:39.359741    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138ee252_68d1_4558_b0ad_13833bb4cfa8.slice/crio-8a05f42df4553a099f5ad84fee772ea56014bf477741f987412d9ba78d359d7f WatchSource:0}: Error finding container 8a05f42df4553a099f5ad84fee772ea56014bf477741f987412d9ba78d359d7f: Status 404 returned error can't find the container with id 8a05f42df4553a099f5ad84fee772ea56014bf477741f987412d9ba78d359d7f
Sep 08 16:36:39.545482 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:39.545442    2547 generic.go:356] "Generic (PLEG): container finished" podID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerID="d6e455ee7440f97b0fcb8d86cde9add4c9c1c10dfb0095aeca9a2b41597669c3" exitCode=0
Sep 08 16:36:39.545912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:39.545491    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr" event={"ID":"43a450e8-2b03-442e-beb5-ab30e7822b03","Type":"ContainerDied","Data":"d6e455ee7440f97b0fcb8d86cde9add4c9c1c10dfb0095aeca9a2b41597669c3"}
Sep 08 16:36:39.547132 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:39.547105    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd" event={"ID":"138ee252-68d1-4558-b0ad-13833bb4cfa8","Type":"ContainerStarted","Data":"8a05f42df4553a099f5ad84fee772ea56014bf477741f987412d9ba78d359d7f"}
Sep 08 16:36:40.555008 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:40.554923    2547 generic.go:356] "Generic (PLEG): container finished" podID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerID="e7622551a67e6351c74727fc97edc67bdabc101a2da0b2842bb36c18632d9730" exitCode=0
Sep 08 16:36:40.555493 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:40.555020    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr" event={"ID":"43a450e8-2b03-442e-beb5-ab30e7822b03","Type":"ContainerDied","Data":"e7622551a67e6351c74727fc97edc67bdabc101a2da0b2842bb36c18632d9730"}
Sep 08 16:36:42.299212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.299184    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:42.458772 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.458736    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-bundle\") pod \"43a450e8-2b03-442e-beb5-ab30e7822b03\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") "
Sep 08 16:36:42.458974 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.458834    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-util\") pod \"43a450e8-2b03-442e-beb5-ab30e7822b03\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") "
Sep 08 16:36:42.458974 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.458862    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vf46m\" (UniqueName: \"kubernetes.io/projected/43a450e8-2b03-442e-beb5-ab30e7822b03-kube-api-access-vf46m\") pod \"43a450e8-2b03-442e-beb5-ab30e7822b03\" (UID: \"43a450e8-2b03-442e-beb5-ab30e7822b03\") "
Sep 08 16:36:42.459477 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.459439    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-bundle" (OuterVolumeSpecName: "bundle") pod "43a450e8-2b03-442e-beb5-ab30e7822b03" (UID: "43a450e8-2b03-442e-beb5-ab30e7822b03"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:42.461082 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.461053    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a450e8-2b03-442e-beb5-ab30e7822b03-kube-api-access-vf46m" (OuterVolumeSpecName: "kube-api-access-vf46m") pod "43a450e8-2b03-442e-beb5-ab30e7822b03" (UID: "43a450e8-2b03-442e-beb5-ab30e7822b03"). InnerVolumeSpecName "kube-api-access-vf46m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:36:42.464173 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.464153    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-util" (OuterVolumeSpecName: "util") pod "43a450e8-2b03-442e-beb5-ab30e7822b03" (UID: "43a450e8-2b03-442e-beb5-ab30e7822b03"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:36:42.560212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.560126    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:42.560212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.560156    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43a450e8-2b03-442e-beb5-ab30e7822b03-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:42.560212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.560166    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vf46m\" (UniqueName: \"kubernetes.io/projected/43a450e8-2b03-442e-beb5-ab30e7822b03-kube-api-access-vf46m\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:36:42.569058 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.569034    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr"
Sep 08 16:36:42.569208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.569060    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0cgsxr" event={"ID":"43a450e8-2b03-442e-beb5-ab30e7822b03","Type":"ContainerDied","Data":"77cbb81ecf98926789609915734e8e923caa63b59976ef65c5fc9cf8f7ac0887"}
Sep 08 16:36:42.569208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.569140    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77cbb81ecf98926789609915734e8e923caa63b59976ef65c5fc9cf8f7ac0887"
Sep 08 16:36:42.570717 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:42.570683    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd" event={"ID":"138ee252-68d1-4558-b0ad-13833bb4cfa8","Type":"ContainerStarted","Data":"8524f4856fd08a78a5202a614f3e75342da7208663ab7487c127f4d5a531039e"}
Sep 08 16:36:43.577060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:43.577025    2547 generic.go:356] "Generic (PLEG): container finished" podID="138ee252-68d1-4558-b0ad-13833bb4cfa8" containerID="8524f4856fd08a78a5202a614f3e75342da7208663ab7487c127f4d5a531039e" exitCode=0
Sep 08 16:36:43.577427 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:43.577113    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd" event={"ID":"138ee252-68d1-4558-b0ad-13833bb4cfa8","Type":"ContainerDied","Data":"8524f4856fd08a78a5202a614f3e75342da7208663ab7487c127f4d5a531039e"}
Sep 08 16:36:44.590045 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:44.589992    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd" event={"ID":"138ee252-68d1-4558-b0ad-13833bb4cfa8","Type":"ContainerStarted","Data":"20edef71a2a520e97d9d8dce3de28ada21443dfa809e03faff7015336d117673"}
Sep 08 16:36:44.590497 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:44.590100    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:44.620519 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:44.620468    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd" podStartSLOduration=1.8725959589999999 podStartE2EDuration="6.620446179s" totalImagesPullingTime="3.663800954s" totalInitContainerRuntime="1.084049266s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:44.619075832 +0000 UTC m=+400.322918832" watchObservedRunningTime="2026-09-08 16:36:44.620446179 +0000 UTC m=+400.324289183"
Sep 08 16:36:55.597586 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:55.597551    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-fqqgd"
Sep 08 16:36:58.611967 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.611938    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"]
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612233    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="util"
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612244    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="util"
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612261    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="pull"
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612268    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="pull"
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612277    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="extract"
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612282    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="extract"
Sep 08 16:36:58.612329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.612331    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a450e8-2b03-442e-beb5-ab30e7822b03" containerName="extract"
Sep 08 16:36:58.616417 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.616400    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.619836 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.619815    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 16:36:58.619970 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.619844    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-cmz69\""
Sep 08 16:36:58.620397 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.620378    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 16:36:58.634719 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.634685    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"]
Sep 08 16:36:58.694975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.694945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f9pg\" (UniqueName: \"kubernetes.io/projected/2ee227a7-72da-4884-a3ed-afe188443ae8-kube-api-access-2f9pg\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.694975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.694983    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee227a7-72da-4884-a3ed-afe188443ae8-tmp\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.695215 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.695021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee227a7-72da-4884-a3ed-afe188443ae8-tls-certs\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.795540 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.795505    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee227a7-72da-4884-a3ed-afe188443ae8-tls-certs\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.795739 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.795588    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9pg\" (UniqueName: \"kubernetes.io/projected/2ee227a7-72da-4884-a3ed-afe188443ae8-kube-api-access-2f9pg\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.795739 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.795626    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee227a7-72da-4884-a3ed-afe188443ae8-tmp\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.798055 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.798035    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee227a7-72da-4884-a3ed-afe188443ae8-tmp\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.798266 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.798247    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ee227a7-72da-4884-a3ed-afe188443ae8-tls-certs\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.807201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.807167    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f9pg\" (UniqueName: \"kubernetes.io/projected/2ee227a7-72da-4884-a3ed-afe188443ae8-kube-api-access-2f9pg\") pod \"kube-auth-proxy-7469867b85-2mtrm\" (UID: \"2ee227a7-72da-4884-a3ed-afe188443ae8\") " pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:58.926303 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:58.926212    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"
Sep 08 16:36:59.142801 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.142751    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"]
Sep 08 16:36:59.147111 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.147093    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.149386 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.149368    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 16:36:59.150174 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.150146    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qnpp5\""
Sep 08 16:36:59.150174 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.150160    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 16:36:59.150323 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.150164    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 16:36:59.155623 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.155601    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"]
Sep 08 16:36:59.199087 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.199004    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-metrics-cert\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.199087 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.199045    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-cert\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.199266 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.199134    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zdnx\" (UniqueName: \"kubernetes.io/projected/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-kube-api-access-9zdnx\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.199266 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.199167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-manager-config\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.205090 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.205066    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7469867b85-2mtrm"]
Sep 08 16:36:59.207741 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:36:59.207716    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee227a7_72da_4884_a3ed_afe188443ae8.slice/crio-7bfbb43d6fe480bf1a77e7b8ee6adbfae66c79dbce18952f2d25b026fcaa1d94 WatchSource:0}: Error finding container 7bfbb43d6fe480bf1a77e7b8ee6adbfae66c79dbce18952f2d25b026fcaa1d94: Status 404 returned error can't find the container with id 7bfbb43d6fe480bf1a77e7b8ee6adbfae66c79dbce18952f2d25b026fcaa1d94
Sep 08 16:36:59.300363 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.300332    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zdnx\" (UniqueName: \"kubernetes.io/projected/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-kube-api-access-9zdnx\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.300542 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.300369    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-manager-config\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.300542 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.300396    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-metrics-cert\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.300542 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.300420    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-cert\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.301049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.301026    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-manager-config\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.303011 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.302983    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-metrics-cert\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.303089 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.303029    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-cert\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.309967 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.309946    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zdnx\" (UniqueName: \"kubernetes.io/projected/5934c9b5-3fdc-4f8e-ae12-490eeb5e2372-kube-api-access-9zdnx\") pod \"lws-controller-manager-76d8558585-lj6dv\" (UID: \"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.458020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.457929    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:36:59.660344 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.660308    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm" event={"ID":"2ee227a7-72da-4884-a3ed-afe188443ae8","Type":"ContainerStarted","Data":"7bfbb43d6fe480bf1a77e7b8ee6adbfae66c79dbce18952f2d25b026fcaa1d94"}
Sep 08 16:36:59.747101 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:36:59.746361    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"]
Sep 08 16:37:00.668032 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:00.667995    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv" event={"ID":"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372","Type":"ContainerStarted","Data":"c74ab5c768ab5cee721346e847115a7767deab6db0f29191f37da57e6363375a"}
Sep 08 16:37:03.684892 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:03.684853    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm" event={"ID":"2ee227a7-72da-4884-a3ed-afe188443ae8","Type":"ContainerStarted","Data":"ab6cea46ab5579cd2e995ef1aab9145bfb5796dec48be56b6a99f9b4b468c534"}
Sep 08 16:37:03.686464 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:03.686443    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv" event={"ID":"5934c9b5-3fdc-4f8e-ae12-490eeb5e2372","Type":"ContainerStarted","Data":"00fe865220584bb94646d2a93a78d0c80b6a8a56eef64e516994e43bd5605a18"}
Sep 08 16:37:03.686580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:03.686555    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:37:03.701552 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:03.701502    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7469867b85-2mtrm" podStartSLOduration=2.273689172 podStartE2EDuration="5.701484438s" totalImagesPullingTime="3.427795266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:03.700156496 +0000 UTC m=+419.403999496" watchObservedRunningTime="2026-09-08 16:37:03.701484438 +0000 UTC m=+419.405327437"
Sep 08 16:37:03.716187 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:03.716127    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv" podStartSLOduration=1.82972453 podStartE2EDuration="4.716106072s" totalImagesPullingTime="2.886381542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:03.715121345 +0000 UTC m=+419.418964380" watchObservedRunningTime="2026-09-08 16:37:03.716106072 +0000 UTC m=+419.419949073"
Sep 08 16:37:14.692560 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:37:14.692530    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76d8558585-lj6dv"
Sep 08 16:38:14.784650 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.784610    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"]
Sep 08 16:38:14.788323 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.788301    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:14.790659 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.790634    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 16:38:14.790659 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.790651    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-s4ll5\""
Sep 08 16:38:14.791452 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.791432    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 16:38:14.797171 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.797148    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"]
Sep 08 16:38:14.881816 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.881767    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"]
Sep 08 16:38:14.885292 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.885272    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:14.894619 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.894596    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"]
Sep 08 16:38:14.938720 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.938684    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:14.938913 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.938726    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlncd\" (UniqueName: \"kubernetes.io/projected/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-kube-api-access-wlncd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:14.938913 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.938760    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:14.986012 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.985978    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"]
Sep 08 16:38:14.989425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.989411    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:14.998912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:14.998886    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"]
Sep 08 16:38:15.039459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039379    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.039459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039417    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlncd\" (UniqueName: \"kubernetes.io/projected/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-kube-api-access-wlncd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.039459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039445    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.039692 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039484    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.039692 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039529    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2c94\" (UniqueName: \"kubernetes.io/projected/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-kube-api-access-l2c94\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.039692 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039559    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.039828 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039811    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.039881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.039870    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.049212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.049188    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlncd\" (UniqueName: \"kubernetes.io/projected/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-kube-api-access-wlncd\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.085360 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.085325    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"]
Sep 08 16:38:15.088920 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.088898    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.098279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.098260    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:15.098860 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.098839    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"]
Sep 08 16:38:15.140342 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140313    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.140533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140352    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.140533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140373    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.140533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140466    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2c94\" (UniqueName: \"kubernetes.io/projected/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-kube-api-access-l2c94\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.140533 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140506    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.140709 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140549    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wh2\" (UniqueName: \"kubernetes.io/projected/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-kube-api-access-55wh2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.140834 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140815    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.140879 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.140850    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.149664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.149615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2c94\" (UniqueName: \"kubernetes.io/projected/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-kube-api-access-l2c94\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.194820 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.194762    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:15.241138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241097    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.241318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241154    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.241318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241192    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.241318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241216    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.241318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241279    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wh2\" (UniqueName: \"kubernetes.io/projected/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-kube-api-access-55wh2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.241318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241305    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhjnj\" (UniqueName: \"kubernetes.io/projected/471c4eac-50ad-4708-9528-54ec17bdbdbf-kube-api-access-fhjnj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.242703 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241583    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.242703 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.241626    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.250760 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.250732    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wh2\" (UniqueName: \"kubernetes.io/projected/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-kube-api-access-55wh2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.299295 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.299217    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:15.342122 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.342092    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.342385 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.342169    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhjnj\" (UniqueName: \"kubernetes.io/projected/471c4eac-50ad-4708-9528-54ec17bdbdbf-kube-api-access-fhjnj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.342385 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.342226    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.342523 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.342436    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.342570 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.342517    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.353324 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.353264    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhjnj\" (UniqueName: \"kubernetes.io/projected/471c4eac-50ad-4708-9528-54ec17bdbdbf-kube-api-access-fhjnj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.371252 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.371190    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"]
Sep 08 16:38:15.375054 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:38:15.375010    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b50f276_15e3_46a8_bfd1_2af3a8c94d0d.slice/crio-bde4c8b0e691c62df060909309048746cb1d19b3a3f61c067f487e8ade4e9213 WatchSource:0}: Error finding container bde4c8b0e691c62df060909309048746cb1d19b3a3f61c067f487e8ade4e9213: Status 404 returned error can't find the container with id bde4c8b0e691c62df060909309048746cb1d19b3a3f61c067f487e8ade4e9213
Sep 08 16:38:15.399133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.399111    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:15.479232 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.479206    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"]
Sep 08 16:38:15.481905 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:38:15.481880    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bc9419b_cb7f_4c7a_9500_7f8b5b1a68d7.slice/crio-5124fa3164826e5b2b49a978c3e78d9a1c1b7d25db1ed94d82eb8295083a5219 WatchSource:0}: Error finding container 5124fa3164826e5b2b49a978c3e78d9a1c1b7d25db1ed94d82eb8295083a5219: Status 404 returned error can't find the container with id 5124fa3164826e5b2b49a978c3e78d9a1c1b7d25db1ed94d82eb8295083a5219
Sep 08 16:38:15.575721 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.575693    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"]
Sep 08 16:38:15.577394 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:38:15.577373    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod100b0c00_0c08_46ae_8cf0_a2dc6361b8c4.slice/crio-bde86f2db5a65c3b9c7623240f8d08c7c668b00389f1e0c789827d65a3001acc WatchSource:0}: Error finding container bde86f2db5a65c3b9c7623240f8d08c7c668b00389f1e0c789827d65a3001acc: Status 404 returned error can't find the container with id bde86f2db5a65c3b9c7623240f8d08c7c668b00389f1e0c789827d65a3001acc
Sep 08 16:38:15.673318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:15.673295    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"]
Sep 08 16:38:15.675289 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:38:15.675260    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod471c4eac_50ad_4708_9528_54ec17bdbdbf.slice/crio-d09304e9367d150f83b86b266b1037b636a8d96e4fa126a81e183c5fa16a2c55 WatchSource:0}: Error finding container d09304e9367d150f83b86b266b1037b636a8d96e4fa126a81e183c5fa16a2c55: Status 404 returned error can't find the container with id d09304e9367d150f83b86b266b1037b636a8d96e4fa126a81e183c5fa16a2c55
Sep 08 16:38:16.032446 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.032418    2547 generic.go:356] "Generic (PLEG): container finished" podID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerID="c447a646c3efee53abf0f39bf79ed2c0defe0fcbc5285d35daff666618575db6" exitCode=0
Sep 08 16:38:16.032867 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.032504    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p" event={"ID":"471c4eac-50ad-4708-9528-54ec17bdbdbf","Type":"ContainerDied","Data":"c447a646c3efee53abf0f39bf79ed2c0defe0fcbc5285d35daff666618575db6"}
Sep 08 16:38:16.032867 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.032559    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p" event={"ID":"471c4eac-50ad-4708-9528-54ec17bdbdbf","Type":"ContainerStarted","Data":"d09304e9367d150f83b86b266b1037b636a8d96e4fa126a81e183c5fa16a2c55"}
Sep 08 16:38:16.034099 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.034083    2547 generic.go:356] "Generic (PLEG): container finished" podID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerID="070a639b0f8e58e7eb60953d83f68e829599673993dcc67be75b45e371e18b73" exitCode=0
Sep 08 16:38:16.034168 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.034142    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69" event={"ID":"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7","Type":"ContainerDied","Data":"070a639b0f8e58e7eb60953d83f68e829599673993dcc67be75b45e371e18b73"}
Sep 08 16:38:16.034225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.034181    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69" event={"ID":"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7","Type":"ContainerStarted","Data":"5124fa3164826e5b2b49a978c3e78d9a1c1b7d25db1ed94d82eb8295083a5219"}
Sep 08 16:38:16.035908 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.035885    2547 generic.go:356] "Generic (PLEG): container finished" podID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerID="ccecc11b34e8af288ae4d9349bdfc5cb64c41f5c0c1c11105de953e85f1f528c" exitCode=0
Sep 08 16:38:16.036012 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.035969    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh" event={"ID":"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d","Type":"ContainerDied","Data":"ccecc11b34e8af288ae4d9349bdfc5cb64c41f5c0c1c11105de953e85f1f528c"}
Sep 08 16:38:16.036074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.036012    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh" event={"ID":"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d","Type":"ContainerStarted","Data":"bde4c8b0e691c62df060909309048746cb1d19b3a3f61c067f487e8ade4e9213"}
Sep 08 16:38:16.037640 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.037622    2547 generic.go:356] "Generic (PLEG): container finished" podID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerID="d4e16ca242db8b3ad042112094227a533cd255d62a23427622cc578991a72a29" exitCode=0
Sep 08 16:38:16.037719 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.037698    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg" event={"ID":"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4","Type":"ContainerDied","Data":"d4e16ca242db8b3ad042112094227a533cd255d62a23427622cc578991a72a29"}
Sep 08 16:38:16.037767 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:16.037737    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg" event={"ID":"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4","Type":"ContainerStarted","Data":"bde86f2db5a65c3b9c7623240f8d08c7c668b00389f1e0c789827d65a3001acc"}
Sep 08 16:38:17.046116 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:17.046073    2547 generic.go:356] "Generic (PLEG): container finished" podID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerID="8044d0a5578690b5814fb294d0e8ab998f2d4a0119a504567182da379a55b0c3" exitCode=0
Sep 08 16:38:17.046550 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:17.046138    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p" event={"ID":"471c4eac-50ad-4708-9528-54ec17bdbdbf","Type":"ContainerDied","Data":"8044d0a5578690b5814fb294d0e8ab998f2d4a0119a504567182da379a55b0c3"}
Sep 08 16:38:17.048020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:17.047992    2547 generic.go:356] "Generic (PLEG): container finished" podID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerID="b1aaf218d939fbe584b4efaf4a33b37fa68183d04cd6070a6e40cae500b9baae" exitCode=0
Sep 08 16:38:17.048128 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:17.048077    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69" event={"ID":"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7","Type":"ContainerDied","Data":"b1aaf218d939fbe584b4efaf4a33b37fa68183d04cd6070a6e40cae500b9baae"}
Sep 08 16:38:17.049992 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:17.049974    2547 generic.go:356] "Generic (PLEG): container finished" podID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerID="d20734ebf8a3af7d2437ccb593596bd4bec4e215e164950de5eacba3901972a7" exitCode=0
Sep 08 16:38:17.050065 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:17.050012    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh" event={"ID":"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d","Type":"ContainerDied","Data":"d20734ebf8a3af7d2437ccb593596bd4bec4e215e164950de5eacba3901972a7"}
Sep 08 16:38:18.057209 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:18.057167    2547 generic.go:356] "Generic (PLEG): container finished" podID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerID="8b679e5eb382ae1cc2129f69ae6b47b01453a3aead7d3f0aa191109350bd18fd" exitCode=0
Sep 08 16:38:18.057614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:18.057252    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p" event={"ID":"471c4eac-50ad-4708-9528-54ec17bdbdbf","Type":"ContainerDied","Data":"8b679e5eb382ae1cc2129f69ae6b47b01453a3aead7d3f0aa191109350bd18fd"}
Sep 08 16:38:18.059285 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:18.059263    2547 generic.go:356] "Generic (PLEG): container finished" podID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerID="d9dce2968dff5ca3c6c79166db343be83548ab3f2886ebc3c69947c12ef386fd" exitCode=0
Sep 08 16:38:18.059409 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:18.059334    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69" event={"ID":"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7","Type":"ContainerDied","Data":"d9dce2968dff5ca3c6c79166db343be83548ab3f2886ebc3c69947c12ef386fd"}
Sep 08 16:38:18.061487 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:18.061463    2547 generic.go:356] "Generic (PLEG): container finished" podID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerID="9fc1bea0404dbe9ecdd999c32415e72fb16ecd154a3d21806f91a34db14cc6f9" exitCode=0
Sep 08 16:38:18.061583 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:18.061551    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh" event={"ID":"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d","Type":"ContainerDied","Data":"9fc1bea0404dbe9ecdd999c32415e72fb16ecd154a3d21806f91a34db14cc6f9"}
Sep 08 16:38:19.073766 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.073723    2547 generic.go:356] "Generic (PLEG): container finished" podID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerID="31c05187b11c1b55ce004ba8185b4a318a6215de07fcf686d9d07fe5d87caed4" exitCode=0
Sep 08 16:38:19.074178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.073767    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg" event={"ID":"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4","Type":"ContainerDied","Data":"31c05187b11c1b55ce004ba8185b4a318a6215de07fcf686d9d07fe5d87caed4"}
Sep 08 16:38:19.217695 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.217668    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:19.283736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.283714    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:19.286492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.286475    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:19.378888 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378758    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhjnj\" (UniqueName: \"kubernetes.io/projected/471c4eac-50ad-4708-9528-54ec17bdbdbf-kube-api-access-fhjnj\") pod \"471c4eac-50ad-4708-9528-54ec17bdbdbf\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") "
Sep 08 16:38:19.378888 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378833    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-bundle\") pod \"471c4eac-50ad-4708-9528-54ec17bdbdbf\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") "
Sep 08 16:38:19.378888 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378860    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-bundle\") pod \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") "
Sep 08 16:38:19.378888 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378881    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2c94\" (UniqueName: \"kubernetes.io/projected/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-kube-api-access-l2c94\") pod \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") "
Sep 08 16:38:19.379191 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378909    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-util\") pod \"471c4eac-50ad-4708-9528-54ec17bdbdbf\" (UID: \"471c4eac-50ad-4708-9528-54ec17bdbdbf\") "
Sep 08 16:38:19.379191 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378934    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-bundle\") pod \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") "
Sep 08 16:38:19.379191 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.378984    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-util\") pod \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") "
Sep 08 16:38:19.379191 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.379030    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlncd\" (UniqueName: \"kubernetes.io/projected/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-kube-api-access-wlncd\") pod \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\" (UID: \"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d\") "
Sep 08 16:38:19.379191 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.379063    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-util\") pod \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\" (UID: \"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7\") "
Sep 08 16:38:19.379811 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.379619    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-bundle" (OuterVolumeSpecName: "bundle") pod "6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" (UID: "6b50f276-15e3-46a8-bfd1-2af3a8c94d0d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:19.380118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.379939    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-bundle" (OuterVolumeSpecName: "bundle") pod "471c4eac-50ad-4708-9528-54ec17bdbdbf" (UID: "471c4eac-50ad-4708-9528-54ec17bdbdbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:19.380314 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.380284    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-bundle" (OuterVolumeSpecName: "bundle") pod "2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" (UID: "2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:19.381559 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.381535    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/471c4eac-50ad-4708-9528-54ec17bdbdbf-kube-api-access-fhjnj" (OuterVolumeSpecName: "kube-api-access-fhjnj") pod "471c4eac-50ad-4708-9528-54ec17bdbdbf" (UID: "471c4eac-50ad-4708-9528-54ec17bdbdbf"). InnerVolumeSpecName "kube-api-access-fhjnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:19.381756 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.381731    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-kube-api-access-l2c94" (OuterVolumeSpecName: "kube-api-access-l2c94") pod "2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" (UID: "2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7"). InnerVolumeSpecName "kube-api-access-l2c94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:19.382063 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.382032    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-kube-api-access-wlncd" (OuterVolumeSpecName: "kube-api-access-wlncd") pod "6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" (UID: "6b50f276-15e3-46a8-bfd1-2af3a8c94d0d"). InnerVolumeSpecName "kube-api-access-wlncd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:19.385581 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.385559    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-util" (OuterVolumeSpecName: "util") pod "471c4eac-50ad-4708-9528-54ec17bdbdbf" (UID: "471c4eac-50ad-4708-9528-54ec17bdbdbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:19.385866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.385843    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-util" (OuterVolumeSpecName: "util") pod "6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" (UID: "6b50f276-15e3-46a8-bfd1-2af3a8c94d0d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:19.385956 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.385939    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-util" (OuterVolumeSpecName: "util") pod "2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" (UID: "2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:19.480210 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480177    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhjnj\" (UniqueName: \"kubernetes.io/projected/471c4eac-50ad-4708-9528-54ec17bdbdbf-kube-api-access-fhjnj\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480210 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480206    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480210 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480218    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480227    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2c94\" (UniqueName: \"kubernetes.io/projected/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-kube-api-access-l2c94\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480235    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/471c4eac-50ad-4708-9528-54ec17bdbdbf-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480243    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480250    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480257    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlncd\" (UniqueName: \"kubernetes.io/projected/6b50f276-15e3-46a8-bfd1-2af3a8c94d0d-kube-api-access-wlncd\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:19.480440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:19.480264    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:20.081269 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.081182    2547 generic.go:356] "Generic (PLEG): container finished" podID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerID="62feb641644443510bc8bf1445bc34d1cb43ec910722bcf50cd3da6f8bfad193" exitCode=0
Sep 08 16:38:20.081269 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.081254    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg" event={"ID":"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4","Type":"ContainerDied","Data":"62feb641644443510bc8bf1445bc34d1cb43ec910722bcf50cd3da6f8bfad193"}
Sep 08 16:38:20.083264 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.083242    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p" event={"ID":"471c4eac-50ad-4708-9528-54ec17bdbdbf","Type":"ContainerDied","Data":"d09304e9367d150f83b86b266b1037b636a8d96e4fa126a81e183c5fa16a2c55"}
Sep 08 16:38:20.083378 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.083282    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d09304e9367d150f83b86b266b1037b636a8d96e4fa126a81e183c5fa16a2c55"
Sep 08 16:38:20.083378 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.083245    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c5ns6p"
Sep 08 16:38:20.085209 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.085180    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69"
Sep 08 16:38:20.085209 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.085180    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajxl69" event={"ID":"2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7","Type":"ContainerDied","Data":"5124fa3164826e5b2b49a978c3e78d9a1c1b7d25db1ed94d82eb8295083a5219"}
Sep 08 16:38:20.085493 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.085217    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5124fa3164826e5b2b49a978c3e78d9a1c1b7d25db1ed94d82eb8295083a5219"
Sep 08 16:38:20.087388 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.087364    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh" event={"ID":"6b50f276-15e3-46a8-bfd1-2af3a8c94d0d","Type":"ContainerDied","Data":"bde4c8b0e691c62df060909309048746cb1d19b3a3f61c067f487e8ade4e9213"}
Sep 08 16:38:20.087500 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.087404    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bde4c8b0e691c62df060909309048746cb1d19b3a3f61c067f487e8ade4e9213"
Sep 08 16:38:20.087500 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:20.087410    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7r4rrh"
Sep 08 16:38:21.229797 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.229748    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:21.395946 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.395845    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-util\") pod \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") "
Sep 08 16:38:21.395946 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.395941    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55wh2\" (UniqueName: \"kubernetes.io/projected/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-kube-api-access-55wh2\") pod \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") "
Sep 08 16:38:21.396173 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.395986    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-bundle\") pod \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\" (UID: \"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4\") "
Sep 08 16:38:21.396437 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.396401    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-bundle" (OuterVolumeSpecName: "bundle") pod "100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" (UID: "100b0c00-0c08-46ae-8cf0-a2dc6361b8c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:21.398228 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.398203    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-kube-api-access-55wh2" (OuterVolumeSpecName: "kube-api-access-55wh2") pod "100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" (UID: "100b0c00-0c08-46ae-8cf0-a2dc6361b8c4"). InnerVolumeSpecName "kube-api-access-55wh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:21.400583 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.400547    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-util" (OuterVolumeSpecName: "util") pod "100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" (UID: "100b0c00-0c08-46ae-8cf0-a2dc6361b8c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:21.496756 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.496721    2547 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-util\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:21.496756 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.496749    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55wh2\" (UniqueName: \"kubernetes.io/projected/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-kube-api-access-55wh2\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:21.496975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:21.496775    2547 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/100b0c00-0c08-46ae-8cf0-a2dc6361b8c4-bundle\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:22.098998 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:22.098969    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg"
Sep 08 16:38:22.098998 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:22.098992    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hmzvg" event={"ID":"100b0c00-0c08-46ae-8cf0-a2dc6361b8c4","Type":"ContainerDied","Data":"bde86f2db5a65c3b9c7623240f8d08c7c668b00389f1e0c789827d65a3001acc"}
Sep 08 16:38:22.099201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:22.099041    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bde86f2db5a65c3b9c7623240f8d08c7c668b00389f1e0c789827d65a3001acc"
Sep 08 16:38:52.809709 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.809674    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"]
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810013    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810024    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810032    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810037    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810046    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810052    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810058    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810062    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810067    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810071    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810079    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810083    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810091    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810096    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810102    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810107    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="util"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810112    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810116    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810122    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810126    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810131    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810137    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810144    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810148    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="pull"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810200    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b50f276-15e3-46a8-bfd1-2af3a8c94d0d" containerName="extract"
Sep 08 16:38:52.810197 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810207    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bc9419b-cb7f-4c7a-9500-7f8b5b1a68d7" containerName="extract"
Sep 08 16:38:52.811016 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810218    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="100b0c00-0c08-46ae-8cf0-a2dc6361b8c4" containerName="extract"
Sep 08 16:38:52.811016 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.810223    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="471c4eac-50ad-4708-9528-54ec17bdbdbf" containerName="extract"
Sep 08 16:38:52.814796 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.814768    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:52.817539 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.817516    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ts7rd\""
Sep 08 16:38:52.817980 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.817964    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 16:38:52.818082 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.818067    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 16:38:52.831717 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.831693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:52.831859 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.831823    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsm4x\" (UniqueName: \"kubernetes.io/projected/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-kube-api-access-xsm4x\") pod \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:52.834063 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.834043    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"]
Sep 08 16:38:52.932509 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.932481    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsm4x\" (UniqueName: \"kubernetes.io/projected/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-kube-api-access-xsm4x\") pod \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:52.932657 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.932531    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:52.932969 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.932952    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:52.942105 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:52.942086    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsm4x\" (UniqueName: \"kubernetes.io/projected/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-kube-api-access-xsm4x\") pod \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:53.125045 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.124962    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:53.402448 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.402424    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"]
Sep 08 16:38:53.404516 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:38:53.404490    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e4fad56_55cb_4759_aef0_2a108cc6e6a7.slice/crio-4034e009ad1060d8b866a6afc6c6bd61a5c1bbb1fb61df5e3b9f5b8fd0327b8b WatchSource:0}: Error finding container 4034e009ad1060d8b866a6afc6c6bd61a5c1bbb1fb61df5e3b9f5b8fd0327b8b: Status 404 returned error can't find the container with id 4034e009ad1060d8b866a6afc6c6bd61a5c1bbb1fb61df5e3b9f5b8fd0327b8b
Sep 08 16:38:53.447011 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.446972    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"]
Sep 08 16:38:53.454360 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.454330    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"]
Sep 08 16:38:53.471809 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.471771    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"]
Sep 08 16:38:53.476565 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.476548    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.493364 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.493328    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"]
Sep 08 16:38:53.537492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.537453    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b62b50-a77a-4357-a021-951d339ab629-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-wds4r\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.537492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.537490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hql5k\" (UniqueName: \"kubernetes.io/projected/29b62b50-a77a-4357-a021-951d339ab629-kube-api-access-hql5k\") pod \"kuadrant-operator-controller-manager-5f685c496f-wds4r\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.638509 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.638474    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b62b50-a77a-4357-a021-951d339ab629-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-wds4r\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.638509 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.638509    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hql5k\" (UniqueName: \"kubernetes.io/projected/29b62b50-a77a-4357-a021-951d339ab629-kube-api-access-hql5k\") pod \"kuadrant-operator-controller-manager-5f685c496f-wds4r\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.638909 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.638891    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b62b50-a77a-4357-a021-951d339ab629-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-wds4r\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.650633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.650605    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hql5k\" (UniqueName: \"kubernetes.io/projected/29b62b50-a77a-4357-a021-951d339ab629-kube-api-access-hql5k\") pod \"kuadrant-operator-controller-manager-5f685c496f-wds4r\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:53.787712 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:53.787683    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:54.076635 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:54.076604    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"]
Sep 08 16:38:54.080168 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:38:54.080135    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29b62b50_a77a_4357_a021_951d339ab629.slice/crio-110e9d7f4e740bd75a0bfeef9d1ce442f40f808df28d9f5e6775a4435954c669 WatchSource:0}: Error finding container 110e9d7f4e740bd75a0bfeef9d1ce442f40f808df28d9f5e6775a4435954c669: Status 404 returned error can't find the container with id 110e9d7f4e740bd75a0bfeef9d1ce442f40f808df28d9f5e6775a4435954c669
Sep 08 16:38:54.263688 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:54.263645    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r" event={"ID":"29b62b50-a77a-4357-a021-951d339ab629","Type":"ContainerStarted","Data":"110e9d7f4e740bd75a0bfeef9d1ce442f40f808df28d9f5e6775a4435954c669"}
Sep 08 16:38:58.293566 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.293501    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" containerName="manager" containerID="cri-o://86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd" gracePeriod=2
Sep 08 16:38:58.295408 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.295371    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r" event={"ID":"29b62b50-a77a-4357-a021-951d339ab629","Type":"ContainerStarted","Data":"1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6"}
Sep 08 16:38:58.295551 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.295434    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:38:58.314770 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.314701    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r" podStartSLOduration=1.900562405 podStartE2EDuration="5.314686005s" totalImagesPullingTime="3.4141236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:38:58.312419487 +0000 UTC m=+534.016262485" watchObservedRunningTime="2026-09-08 16:38:58.314686005 +0000 UTC m=+534.018529003"
Sep 08 16:38:58.539183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.539162    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:58.541146 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:38:58.541124    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:58.585663 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.585599    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsm4x\" (UniqueName: \"kubernetes.io/projected/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-kube-api-access-xsm4x\") pod \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") "
Sep 08 16:38:58.585663 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.585654    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-extensions-socket-volume\") pod \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\" (UID: \"6e4fad56-55cb-4759-aef0-2a108cc6e6a7\") "
Sep 08 16:38:58.585986 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.585958    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6e4fad56-55cb-4759-aef0-2a108cc6e6a7" (UID: "6e4fad56-55cb-4759-aef0-2a108cc6e6a7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:38:58.588017 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.587998    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-kube-api-access-xsm4x" (OuterVolumeSpecName: "kube-api-access-xsm4x") pod "6e4fad56-55cb-4759-aef0-2a108cc6e6a7" (UID: "6e4fad56-55cb-4759-aef0-2a108cc6e6a7"). InnerVolumeSpecName "kube-api-access-xsm4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:38:58.687072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.687045    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsm4x\" (UniqueName: \"kubernetes.io/projected/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-kube-api-access-xsm4x\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:58.687072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.687068    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e4fad56-55cb-4759-aef0-2a108cc6e6a7-extensions-socket-volume\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:38:58.834678 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:58.834646    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" path="/var/lib/kubelet/pods/6e4fad56-55cb-4759-aef0-2a108cc6e6a7/volumes"
Sep 08 16:38:59.301826 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:59.301794    2547 generic.go:356] "Generic (PLEG): container finished" podID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" containerID="86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd" exitCode=2
Sep 08 16:38:59.302187 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:59.301839    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:59.302187 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:59.301888    2547 scope.go:117] "RemoveContainer" containerID="86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd"
Sep 08 16:38:59.306240 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:38:59.306214    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-5sd4v\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-5sd4v"
Sep 08 16:38:59.310876 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:59.310857    2547 scope.go:117] "RemoveContainer" containerID="86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd"
Sep 08 16:38:59.311139 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:38:59.311123    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd\": container with ID starting with 86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd not found: ID does not exist" containerID="86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd"
Sep 08 16:38:59.311178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:38:59.311147    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd"} err="failed to get container status \"86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd\": rpc error: code = NotFound desc = could not find container \"86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd\": container with ID starting with 86d33c16241b18d02976406744f7a5fe6f7074b00b6204b494dc8e78df90fadd not found: ID does not exist"
Sep 08 16:39:09.305138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:09.305105    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:39:22.445015 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.444979    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"]
Sep 08 16:39:22.445385 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.445161    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r" podUID="29b62b50-a77a-4357-a021-951d339ab629" containerName="manager" containerID="cri-o://1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6" gracePeriod=10
Sep 08 16:39:22.683256 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.683235    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:39:22.780820 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.780766    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hql5k\" (UniqueName: \"kubernetes.io/projected/29b62b50-a77a-4357-a021-951d339ab629-kube-api-access-hql5k\") pod \"29b62b50-a77a-4357-a021-951d339ab629\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") "
Sep 08 16:39:22.780976 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.780865    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b62b50-a77a-4357-a021-951d339ab629-extensions-socket-volume\") pod \"29b62b50-a77a-4357-a021-951d339ab629\" (UID: \"29b62b50-a77a-4357-a021-951d339ab629\") "
Sep 08 16:39:22.781208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.781186    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29b62b50-a77a-4357-a021-951d339ab629-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "29b62b50-a77a-4357-a021-951d339ab629" (UID: "29b62b50-a77a-4357-a021-951d339ab629"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:39:22.783072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.783052    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29b62b50-a77a-4357-a021-951d339ab629-kube-api-access-hql5k" (OuterVolumeSpecName: "kube-api-access-hql5k") pod "29b62b50-a77a-4357-a021-951d339ab629" (UID: "29b62b50-a77a-4357-a021-951d339ab629"). InnerVolumeSpecName "kube-api-access-hql5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:22.881512 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.881477    2547 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/29b62b50-a77a-4357-a021-951d339ab629-extensions-socket-volume\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:39:22.881512 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:22.881505    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hql5k\" (UniqueName: \"kubernetes.io/projected/29b62b50-a77a-4357-a021-951d339ab629-kube-api-access-hql5k\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:39:23.428068 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.428028    2547 generic.go:356] "Generic (PLEG): container finished" podID="29b62b50-a77a-4357-a021-951d339ab629" containerID="1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6" exitCode=0
Sep 08 16:39:23.428068 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.428072    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"
Sep 08 16:39:23.428317 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.428120    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r" event={"ID":"29b62b50-a77a-4357-a021-951d339ab629","Type":"ContainerDied","Data":"1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6"}
Sep 08 16:39:23.428317 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.428176    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r" event={"ID":"29b62b50-a77a-4357-a021-951d339ab629","Type":"ContainerDied","Data":"110e9d7f4e740bd75a0bfeef9d1ce442f40f808df28d9f5e6775a4435954c669"}
Sep 08 16:39:23.428317 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.428198    2547 scope.go:117] "RemoveContainer" containerID="1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6"
Sep 08 16:39:23.437576 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.437558    2547 scope.go:117] "RemoveContainer" containerID="1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6"
Sep 08 16:39:23.437852 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:39:23.437833    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6\": container with ID starting with 1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6 not found: ID does not exist" containerID="1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6"
Sep 08 16:39:23.437950 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.437858    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6"} err="failed to get container status \"1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6\": rpc error: code = NotFound desc = could not find container \"1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6\": container with ID starting with 1febc99b1acbcbfc76fe75141eeb16f97763dc02088dfe05d84c0cbfe64584e6 not found: ID does not exist"
Sep 08 16:39:23.448612 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.448583    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"]
Sep 08 16:39:23.454849 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:23.454828    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-wds4r"]
Sep 08 16:39:24.832248 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:24.832215    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29b62b50-a77a-4357-a021-951d339ab629" path="/var/lib/kubelet/pods/29b62b50-a77a-4357-a021-951d339ab629/volumes"
Sep 08 16:39:40.323430 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323385    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:40.323881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323727    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" containerName="manager"
Sep 08 16:39:40.323881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323739    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" containerName="manager"
Sep 08 16:39:40.323881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323765    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29b62b50-a77a-4357-a021-951d339ab629" containerName="manager"
Sep 08 16:39:40.323881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323771    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="29b62b50-a77a-4357-a021-951d339ab629" containerName="manager"
Sep 08 16:39:40.323881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323862    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="29b62b50-a77a-4357-a021-951d339ab629" containerName="manager"
Sep 08 16:39:40.323881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.323871    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e4fad56-55cb-4759-aef0-2a108cc6e6a7" containerName="manager"
Sep 08 16:39:40.326855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.326837    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.329193 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.329169    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nbn2c\""
Sep 08 16:39:40.329193 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.329187    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 16:39:40.329359 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.329190    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 16:39:40.329901 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.329883    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 16:39:40.335375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.335351    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:40.418253 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.418219    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:40.424325 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.424296    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rg5v\" (UniqueName: \"kubernetes.io/projected/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-kube-api-access-7rg5v\") pod \"limitador-limitador-8588749977-88cpv\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") " pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.424451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.424404    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-config-file\") pod \"limitador-limitador-8588749977-88cpv\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") " pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.525805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.525757    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rg5v\" (UniqueName: \"kubernetes.io/projected/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-kube-api-access-7rg5v\") pod \"limitador-limitador-8588749977-88cpv\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") " pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.525947 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.525855    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-config-file\") pod \"limitador-limitador-8588749977-88cpv\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") " pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.526476 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.526459    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-config-file\") pod \"limitador-limitador-8588749977-88cpv\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") " pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.533862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.533833    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rg5v\" (UniqueName: \"kubernetes.io/projected/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-kube-api-access-7rg5v\") pod \"limitador-limitador-8588749977-88cpv\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") " pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.636772 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.636695    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:40.909270 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:40.909244    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:40.911489 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:39:40.911462    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66d1f42_5090_4dd4_8eca_dea16be4b0d5.slice/crio-0e66793b2747c916ec6ef23902ac4fc87a8db61727055223f71698f858e8cde6 WatchSource:0}: Error finding container 0e66793b2747c916ec6ef23902ac4fc87a8db61727055223f71698f858e8cde6: Status 404 returned error can't find the container with id 0e66793b2747c916ec6ef23902ac4fc87a8db61727055223f71698f858e8cde6
Sep 08 16:39:41.125584 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.125553    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jnfwt"]
Sep 08 16:39:41.129874 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.129856    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:41.132173 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.132155    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kvtdc\""
Sep 08 16:39:41.136964 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.136941    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jnfwt"]
Sep 08 16:39:41.231582 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.231502    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nchw5\" (UniqueName: \"kubernetes.io/projected/7aee97c6-30aa-4673-a91b-72e9ffe7a961-kube-api-access-nchw5\") pod \"authorino-7bcfd8f9cd-jnfwt\" (UID: \"7aee97c6-30aa-4673-a91b-72e9ffe7a961\") " pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:41.246432 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.246401    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qct7"]
Sep 08 16:39:41.249696 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.249677    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:39:41.256493 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.256325    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qct7"]
Sep 08 16:39:41.332899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.332874    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nchw5\" (UniqueName: \"kubernetes.io/projected/7aee97c6-30aa-4673-a91b-72e9ffe7a961-kube-api-access-nchw5\") pod \"authorino-7bcfd8f9cd-jnfwt\" (UID: \"7aee97c6-30aa-4673-a91b-72e9ffe7a961\") " pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:41.333256 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.332910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76zz9\" (UniqueName: \"kubernetes.io/projected/5ba28c84-e073-4467-a0b8-becb50608c54-kube-api-access-76zz9\") pod \"authorino-59c974bd48-7qct7\" (UID: \"5ba28c84-e073-4467-a0b8-becb50608c54\") " pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:39:41.345859 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.345830    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nchw5\" (UniqueName: \"kubernetes.io/projected/7aee97c6-30aa-4673-a91b-72e9ffe7a961-kube-api-access-nchw5\") pod \"authorino-7bcfd8f9cd-jnfwt\" (UID: \"7aee97c6-30aa-4673-a91b-72e9ffe7a961\") " pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:41.434115 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.434085    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76zz9\" (UniqueName: \"kubernetes.io/projected/5ba28c84-e073-4467-a0b8-becb50608c54-kube-api-access-76zz9\") pod \"authorino-59c974bd48-7qct7\" (UID: \"5ba28c84-e073-4467-a0b8-becb50608c54\") " pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:39:41.438936 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.438917    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:41.443077 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.443059    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76zz9\" (UniqueName: \"kubernetes.io/projected/5ba28c84-e073-4467-a0b8-becb50608c54-kube-api-access-76zz9\") pod \"authorino-59c974bd48-7qct7\" (UID: \"5ba28c84-e073-4467-a0b8-becb50608c54\") " pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:39:41.522281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.522253    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-88cpv" event={"ID":"c66d1f42-5090-4dd4-8eca-dea16be4b0d5","Type":"ContainerStarted","Data":"0e66793b2747c916ec6ef23902ac4fc87a8db61727055223f71698f858e8cde6"}
Sep 08 16:39:41.559743 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.559711    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:39:41.711920 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.711748    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jnfwt"]
Sep 08 16:39:41.714562 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:39:41.714531    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7aee97c6_30aa_4673_a91b_72e9ffe7a961.slice/crio-083f4a7aeb95da6abdef737555143c1335593e31e7f129ef280bc83e9db07325 WatchSource:0}: Error finding container 083f4a7aeb95da6abdef737555143c1335593e31e7f129ef280bc83e9db07325: Status 404 returned error can't find the container with id 083f4a7aeb95da6abdef737555143c1335593e31e7f129ef280bc83e9db07325
Sep 08 16:39:41.830592 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:41.830566    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qct7"]
Sep 08 16:39:41.983515 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:39:41.983468    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ba28c84_e073_4467_a0b8_becb50608c54.slice/crio-07e72285577d57ebd2fb30456b7fd4c80051f713606f518390e41454dc5964be WatchSource:0}: Error finding container 07e72285577d57ebd2fb30456b7fd4c80051f713606f518390e41454dc5964be: Status 404 returned error can't find the container with id 07e72285577d57ebd2fb30456b7fd4c80051f713606f518390e41454dc5964be
Sep 08 16:39:42.529451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:42.529415    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qct7" event={"ID":"5ba28c84-e073-4467-a0b8-becb50608c54","Type":"ContainerStarted","Data":"07e72285577d57ebd2fb30456b7fd4c80051f713606f518390e41454dc5964be"}
Sep 08 16:39:42.531024 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:42.531000    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-88cpv" event={"ID":"c66d1f42-5090-4dd4-8eca-dea16be4b0d5","Type":"ContainerStarted","Data":"afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7"}
Sep 08 16:39:42.531134 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:42.531073    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:42.532107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:42.532088    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt" event={"ID":"7aee97c6-30aa-4673-a91b-72e9ffe7a961","Type":"ContainerStarted","Data":"083f4a7aeb95da6abdef737555143c1335593e31e7f129ef280bc83e9db07325"}
Sep 08 16:39:42.551985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:42.551946    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-88cpv" podStartSLOduration=1.425875516 podStartE2EDuration="2.55193366s" totalImagesPullingTime="1.126058144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:42.551482971 +0000 UTC m=+578.255325971" watchObservedRunningTime="2026-09-08 16:39:42.55193366 +0000 UTC m=+578.255776660"
Sep 08 16:39:44.546122 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:44.546083    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qct7" event={"ID":"5ba28c84-e073-4467-a0b8-becb50608c54","Type":"ContainerStarted","Data":"f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8"}
Sep 08 16:39:44.559643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:44.559597    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-7qct7" podStartSLOduration=1.746264502 podStartE2EDuration="3.559582069s" totalImagesPullingTime="1.813317567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:44.558474232 +0000 UTC m=+580.262317233" watchObservedRunningTime="2026-09-08 16:39:44.559582069 +0000 UTC m=+580.263425070"
Sep 08 16:39:44.587077 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:44.587049    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jnfwt"]
Sep 08 16:39:50.581326 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:50.581289    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt" event={"ID":"7aee97c6-30aa-4673-a91b-72e9ffe7a961","Type":"ContainerStarted","Data":"7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2"}
Sep 08 16:39:50.581811 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:50.581351    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt" podUID="7aee97c6-30aa-4673-a91b-72e9ffe7a961" containerName="authorino" containerID="cri-o://7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2" gracePeriod=30
Sep 08 16:39:50.596707 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:50.596667    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt" podStartSLOduration=1.458069592 podStartE2EDuration="9.596651499s" totalImagesPullingTime="8.138581907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:50.595143195 +0000 UTC m=+586.298986194" watchObservedRunningTime="2026-09-08 16:39:50.596651499 +0000 UTC m=+586.300494498"
Sep 08 16:39:50.830082 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:50.830058    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:51.018486 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.018390    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nchw5\" (UniqueName: \"kubernetes.io/projected/7aee97c6-30aa-4673-a91b-72e9ffe7a961-kube-api-access-nchw5\") pod \"7aee97c6-30aa-4673-a91b-72e9ffe7a961\" (UID: \"7aee97c6-30aa-4673-a91b-72e9ffe7a961\") "
Sep 08 16:39:51.020595 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.020557    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aee97c6-30aa-4673-a91b-72e9ffe7a961-kube-api-access-nchw5" (OuterVolumeSpecName: "kube-api-access-nchw5") pod "7aee97c6-30aa-4673-a91b-72e9ffe7a961" (UID: "7aee97c6-30aa-4673-a91b-72e9ffe7a961"). InnerVolumeSpecName "kube-api-access-nchw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:51.119257 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.119225    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nchw5\" (UniqueName: \"kubernetes.io/projected/7aee97c6-30aa-4673-a91b-72e9ffe7a961-kube-api-access-nchw5\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:39:51.587712 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.587674    2547 generic.go:356] "Generic (PLEG): container finished" podID="7aee97c6-30aa-4673-a91b-72e9ffe7a961" containerID="7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2" exitCode=0
Sep 08 16:39:51.587712 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.587710    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt"
Sep 08 16:39:51.588225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.587813    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt" event={"ID":"7aee97c6-30aa-4673-a91b-72e9ffe7a961","Type":"ContainerDied","Data":"7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2"}
Sep 08 16:39:51.588225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.587860    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-jnfwt" event={"ID":"7aee97c6-30aa-4673-a91b-72e9ffe7a961","Type":"ContainerDied","Data":"083f4a7aeb95da6abdef737555143c1335593e31e7f129ef280bc83e9db07325"}
Sep 08 16:39:51.588225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.587876    2547 scope.go:117] "RemoveContainer" containerID="7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2"
Sep 08 16:39:51.596809 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.596709    2547 scope.go:117] "RemoveContainer" containerID="7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2"
Sep 08 16:39:51.597063 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:39:51.597039    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2\": container with ID starting with 7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2 not found: ID does not exist" containerID="7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2"
Sep 08 16:39:51.597155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.597068    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2"} err="failed to get container status \"7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2\": rpc error: code = NotFound desc = could not find container \"7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2\": container with ID starting with 7bcd154fa243d6465cb6f0f69f92f74e7655269c7185c2f48c4f90e6749462f2 not found: ID does not exist"
Sep 08 16:39:51.609691 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.609669    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jnfwt"]
Sep 08 16:39:51.611612 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:51.611589    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-jnfwt"]
Sep 08 16:39:51.611834 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:39:51.611815    2547 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7aee97c6_30aa_4673_a91b_72e9ffe7a961.slice\": RecentStats: unable to find data in memory cache]"
Sep 08 16:39:52.832360 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:52.832325    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aee97c6-30aa-4673-a91b-72e9ffe7a961" path="/var/lib/kubelet/pods/7aee97c6-30aa-4673-a91b-72e9ffe7a961/volumes"
Sep 08 16:39:53.539507 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:53.539480    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:53.556151 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:53.556125    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:53.599309 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:53.599272    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-88cpv" podUID="c66d1f42-5090-4dd4-8eca-dea16be4b0d5" containerName="limitador" containerID="cri-o://afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7" gracePeriod=30
Sep 08 16:39:54.160656 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.160600    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:54.240261 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.240227    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rg5v\" (UniqueName: \"kubernetes.io/projected/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-kube-api-access-7rg5v\") pod \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") "
Sep 08 16:39:54.240261 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.240266    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-config-file\") pod \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\" (UID: \"c66d1f42-5090-4dd4-8eca-dea16be4b0d5\") "
Sep 08 16:39:54.240620 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.240598    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-config-file" (OuterVolumeSpecName: "config-file") pod "c66d1f42-5090-4dd4-8eca-dea16be4b0d5" (UID: "c66d1f42-5090-4dd4-8eca-dea16be4b0d5"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:39:54.242400 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.242376    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-kube-api-access-7rg5v" (OuterVolumeSpecName: "kube-api-access-7rg5v") pod "c66d1f42-5090-4dd4-8eca-dea16be4b0d5" (UID: "c66d1f42-5090-4dd4-8eca-dea16be4b0d5"). InnerVolumeSpecName "kube-api-access-7rg5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:39:54.341091 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.341056    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rg5v\" (UniqueName: \"kubernetes.io/projected/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-kube-api-access-7rg5v\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:39:54.341091 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.341082    2547 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c66d1f42-5090-4dd4-8eca-dea16be4b0d5-config-file\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:39:54.605477 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.605441    2547 generic.go:356] "Generic (PLEG): container finished" podID="c66d1f42-5090-4dd4-8eca-dea16be4b0d5" containerID="afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7" exitCode=0
Sep 08 16:39:54.605637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.605487    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-88cpv"
Sep 08 16:39:54.605637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.605499    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-88cpv" event={"ID":"c66d1f42-5090-4dd4-8eca-dea16be4b0d5","Type":"ContainerDied","Data":"afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7"}
Sep 08 16:39:54.605637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.605550    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-88cpv" event={"ID":"c66d1f42-5090-4dd4-8eca-dea16be4b0d5","Type":"ContainerDied","Data":"0e66793b2747c916ec6ef23902ac4fc87a8db61727055223f71698f858e8cde6"}
Sep 08 16:39:54.605637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.605581    2547 scope.go:117] "RemoveContainer" containerID="afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7"
Sep 08 16:39:54.614298 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.614280    2547 scope.go:117] "RemoveContainer" containerID="afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7"
Sep 08 16:39:54.614548 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:39:54.614527    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7\": container with ID starting with afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7 not found: ID does not exist" containerID="afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7"
Sep 08 16:39:54.614598 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.614555    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7"} err="failed to get container status \"afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7\": rpc error: code = NotFound desc = could not find container \"afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7\": container with ID starting with afa09cfef3b6ad0584f1299a7067a278b8b87ddfa1eacafd4cccb7aad289fbc7 not found: ID does not exist"
Sep 08 16:39:54.625396 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.625374    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:54.634922 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.629923    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-88cpv"]
Sep 08 16:39:54.832858 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:39:54.832825    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c66d1f42-5090-4dd4-8eca-dea16be4b0d5" path="/var/lib/kubelet/pods/c66d1f42-5090-4dd4-8eca-dea16be4b0d5/volumes"
Sep 08 16:40:00.023185 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023151    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"]
Sep 08 16:40:00.023614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023502    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66d1f42-5090-4dd4-8eca-dea16be4b0d5" containerName="limitador"
Sep 08 16:40:00.023614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023516    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66d1f42-5090-4dd4-8eca-dea16be4b0d5" containerName="limitador"
Sep 08 16:40:00.023614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023533    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aee97c6-30aa-4673-a91b-72e9ffe7a961" containerName="authorino"
Sep 08 16:40:00.023614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023539    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aee97c6-30aa-4673-a91b-72e9ffe7a961" containerName="authorino"
Sep 08 16:40:00.023614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023599    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aee97c6-30aa-4673-a91b-72e9ffe7a961" containerName="authorino"
Sep 08 16:40:00.023614 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.023611    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c66d1f42-5090-4dd4-8eca-dea16be4b0d5" containerName="limitador"
Sep 08 16:40:00.028471 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.028442    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.031630 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.031604    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 16:40:00.031855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.031604    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:40:00.031855 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.031677    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 16:40:00.032589 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.032570    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-d4n62\""
Sep 08 16:40:00.035176 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.035146    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"]
Sep 08 16:40:00.083658 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.083620    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b48v\" (UniqueName: \"kubernetes.io/projected/364c8320-ab13-4799-950a-c68e3c21fb83-kube-api-access-5b48v\") pod \"postgres-69fb4594cf-ftzj6\" (UID: \"364c8320-ab13-4799-950a-c68e3c21fb83\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.083658 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.083673    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/364c8320-ab13-4799-950a-c68e3c21fb83-data\") pod \"postgres-69fb4594cf-ftzj6\" (UID: \"364c8320-ab13-4799-950a-c68e3c21fb83\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.184482 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.184438    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/364c8320-ab13-4799-950a-c68e3c21fb83-data\") pod \"postgres-69fb4594cf-ftzj6\" (UID: \"364c8320-ab13-4799-950a-c68e3c21fb83\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.184651 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.184546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b48v\" (UniqueName: \"kubernetes.io/projected/364c8320-ab13-4799-950a-c68e3c21fb83-kube-api-access-5b48v\") pod \"postgres-69fb4594cf-ftzj6\" (UID: \"364c8320-ab13-4799-950a-c68e3c21fb83\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.184947 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.184925    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/364c8320-ab13-4799-950a-c68e3c21fb83-data\") pod \"postgres-69fb4594cf-ftzj6\" (UID: \"364c8320-ab13-4799-950a-c68e3c21fb83\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.192891 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.192869    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b48v\" (UniqueName: \"kubernetes.io/projected/364c8320-ab13-4799-950a-c68e3c21fb83-kube-api-access-5b48v\") pod \"postgres-69fb4594cf-ftzj6\" (UID: \"364c8320-ab13-4799-950a-c68e3c21fb83\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.339880 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.339847    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:00.613309 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.613280    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"]
Sep 08 16:40:00.615020 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:40:00.614987    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod364c8320_ab13_4799_950a_c68e3c21fb83.slice/crio-cee65cdfd756674fce45c0d10d548d44462b5d46463623c59ac1defb8af79e67 WatchSource:0}: Error finding container cee65cdfd756674fce45c0d10d548d44462b5d46463623c59ac1defb8af79e67: Status 404 returned error can't find the container with id cee65cdfd756674fce45c0d10d548d44462b5d46463623c59ac1defb8af79e67
Sep 08 16:40:00.638343 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:00.638317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6" event={"ID":"364c8320-ab13-4799-950a-c68e3c21fb83","Type":"ContainerStarted","Data":"cee65cdfd756674fce45c0d10d548d44462b5d46463623c59ac1defb8af79e67"}
Sep 08 16:40:05.617343 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:05.617306    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:40:05.619405 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:05.619381    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:40:05.665303 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:05.665277    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 16:40:06.675440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:06.675402    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6" event={"ID":"364c8320-ab13-4799-950a-c68e3c21fb83","Type":"ContainerStarted","Data":"481beb6ae5cd9c9a2356d8c09f6605c14642c5f916f098a29154308ec0060a94"}
Sep 08 16:40:06.675886 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:06.675544    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:06.692583 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:06.692528    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6" podStartSLOduration=1.645830581 podStartE2EDuration="6.692512517s" totalImagesPullingTime="5.046681936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:06.690423117 +0000 UTC m=+602.394266118" watchObservedRunningTime="2026-09-08 16:40:06.692512517 +0000 UTC m=+602.396355516"
Sep 08 16:40:12.710978 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:12.710951    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ftzj6"
Sep 08 16:40:13.255450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.255421    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-49ldw"]
Sep 08 16:40:13.258965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.258948    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:13.266382 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.266363    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-49ldw"]
Sep 08 16:40:13.300202 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.300169    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46257\" (UniqueName: \"kubernetes.io/projected/cb211475-bc29-4576-ad9c-60f598570f06-kube-api-access-46257\") pod \"authorino-557f876f69-49ldw\" (UID: \"cb211475-bc29-4576-ad9c-60f598570f06\") " pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:13.386565 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.386530    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-49ldw"]
Sep 08 16:40:13.386822 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:40:13.386799    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-46257], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-49ldw" podUID="cb211475-bc29-4576-ad9c-60f598570f06"
Sep 08 16:40:13.400713 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.400680    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46257\" (UniqueName: \"kubernetes.io/projected/cb211475-bc29-4576-ad9c-60f598570f06-kube-api-access-46257\") pod \"authorino-557f876f69-49ldw\" (UID: \"cb211475-bc29-4576-ad9c-60f598570f06\") " pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:13.416849 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.416813    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46257\" (UniqueName: \"kubernetes.io/projected/cb211475-bc29-4576-ad9c-60f598570f06-kube-api-access-46257\") pod \"authorino-557f876f69-49ldw\" (UID: \"cb211475-bc29-4576-ad9c-60f598570f06\") " pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:13.417994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.417970    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-f2rtn"]
Sep 08 16:40:13.421944 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.421922    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.423721 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.423695    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-f2rtn"]
Sep 08 16:40:13.424279 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.424262    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 16:40:13.500590 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.500553    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-f2rtn"]
Sep 08 16:40:13.500839 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:40:13.500818    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-t9mdn tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-f2rtn" podUID="d63e3376-02b0-4ad3-b155-0022cf76d0ee"
Sep 08 16:40:13.501058 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.501044    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9mdn\" (UniqueName: \"kubernetes.io/projected/d63e3376-02b0-4ad3-b155-0022cf76d0ee-kube-api-access-t9mdn\") pod \"authorino-6d4dfc649f-f2rtn\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") " pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.501108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.501097    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d63e3376-02b0-4ad3-b155-0022cf76d0ee-tls-cert\") pod \"authorino-6d4dfc649f-f2rtn\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") " pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.525833 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.525810    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-69986476d6-hqpcj"]
Sep 08 16:40:13.529907 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.529889    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.534640 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.534614    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69986476d6-hqpcj"]
Sep 08 16:40:13.601919 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.601886    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk96c\" (UniqueName: \"kubernetes.io/projected/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-kube-api-access-hk96c\") pod \"authorino-69986476d6-hqpcj\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") " pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.602107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.601936    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d63e3376-02b0-4ad3-b155-0022cf76d0ee-tls-cert\") pod \"authorino-6d4dfc649f-f2rtn\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") " pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.602107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.601964    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9mdn\" (UniqueName: \"kubernetes.io/projected/d63e3376-02b0-4ad3-b155-0022cf76d0ee-kube-api-access-t9mdn\") pod \"authorino-6d4dfc649f-f2rtn\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") " pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.602107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.601979    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-tls-cert\") pod \"authorino-69986476d6-hqpcj\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") " pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.604399 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.604380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d63e3376-02b0-4ad3-b155-0022cf76d0ee-tls-cert\") pod \"authorino-6d4dfc649f-f2rtn\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") " pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.609213 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.609193    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9mdn\" (UniqueName: \"kubernetes.io/projected/d63e3376-02b0-4ad3-b155-0022cf76d0ee-kube-api-access-t9mdn\") pod \"authorino-6d4dfc649f-f2rtn\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") " pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.703322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.703285    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk96c\" (UniqueName: \"kubernetes.io/projected/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-kube-api-access-hk96c\") pod \"authorino-69986476d6-hqpcj\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") " pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.703488 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.703352    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-tls-cert\") pod \"authorino-69986476d6-hqpcj\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") " pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.705844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.705823    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-tls-cert\") pod \"authorino-69986476d6-hqpcj\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") " pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.711171 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.711146    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk96c\" (UniqueName: \"kubernetes.io/projected/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-kube-api-access-hk96c\") pod \"authorino-69986476d6-hqpcj\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") " pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.712477 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.712463    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.712477 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.712469    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:13.726825 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.726804    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:13.729857 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.729838    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:13.803822 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.803718    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46257\" (UniqueName: \"kubernetes.io/projected/cb211475-bc29-4576-ad9c-60f598570f06-kube-api-access-46257\") pod \"cb211475-bc29-4576-ad9c-60f598570f06\" (UID: \"cb211475-bc29-4576-ad9c-60f598570f06\") "
Sep 08 16:40:13.803822 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.803752    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9mdn\" (UniqueName: \"kubernetes.io/projected/d63e3376-02b0-4ad3-b155-0022cf76d0ee-kube-api-access-t9mdn\") pod \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") "
Sep 08 16:40:13.803822 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.803769    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d63e3376-02b0-4ad3-b155-0022cf76d0ee-tls-cert\") pod \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\" (UID: \"d63e3376-02b0-4ad3-b155-0022cf76d0ee\") "
Sep 08 16:40:13.806012 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.805981    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d63e3376-02b0-4ad3-b155-0022cf76d0ee-kube-api-access-t9mdn" (OuterVolumeSpecName: "kube-api-access-t9mdn") pod "d63e3376-02b0-4ad3-b155-0022cf76d0ee" (UID: "d63e3376-02b0-4ad3-b155-0022cf76d0ee"). InnerVolumeSpecName "kube-api-access-t9mdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:40:13.806012 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.805981    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d63e3376-02b0-4ad3-b155-0022cf76d0ee-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d63e3376-02b0-4ad3-b155-0022cf76d0ee" (UID: "d63e3376-02b0-4ad3-b155-0022cf76d0ee"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:40:13.806183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.806052    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb211475-bc29-4576-ad9c-60f598570f06-kube-api-access-46257" (OuterVolumeSpecName: "kube-api-access-46257") pod "cb211475-bc29-4576-ad9c-60f598570f06" (UID: "cb211475-bc29-4576-ad9c-60f598570f06"). InnerVolumeSpecName "kube-api-access-46257". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:40:13.839255 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.839228    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:40:13.905350 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.905320    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46257\" (UniqueName: \"kubernetes.io/projected/cb211475-bc29-4576-ad9c-60f598570f06-kube-api-access-46257\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:13.905350 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.905351    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9mdn\" (UniqueName: \"kubernetes.io/projected/d63e3376-02b0-4ad3-b155-0022cf76d0ee-kube-api-access-t9mdn\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:13.905500 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:13.905360    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d63e3376-02b0-4ad3-b155-0022cf76d0ee-tls-cert\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:14.109156 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.109130    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-69986476d6-hqpcj"]
Sep 08 16:40:14.111266 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:40:14.111243    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea2ca84a_4b42_4d00_9b0c_7dfeb5aaa506.slice/crio-5b6fa4496c69f680a2bccd934837da79c398c3f3969a5759efa6872ad5b7aa96 WatchSource:0}: Error finding container 5b6fa4496c69f680a2bccd934837da79c398c3f3969a5759efa6872ad5b7aa96: Status 404 returned error can't find the container with id 5b6fa4496c69f680a2bccd934837da79c398c3f3969a5759efa6872ad5b7aa96
Sep 08 16:40:14.718753 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.718673    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-49ldw"
Sep 08 16:40:14.718753 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.718694    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-f2rtn"
Sep 08 16:40:14.719155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.718672    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69986476d6-hqpcj" event={"ID":"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506","Type":"ContainerStarted","Data":"5b6fa4496c69f680a2bccd934837da79c398c3f3969a5759efa6872ad5b7aa96"}
Sep 08 16:40:14.749704 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.749676    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-f2rtn"]
Sep 08 16:40:14.753548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.753523    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-f2rtn"]
Sep 08 16:40:14.772954 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.772922    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-49ldw"]
Sep 08 16:40:14.778922 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.778896    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-49ldw"]
Sep 08 16:40:14.832998 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.832964    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb211475-bc29-4576-ad9c-60f598570f06" path="/var/lib/kubelet/pods/cb211475-bc29-4576-ad9c-60f598570f06/volumes"
Sep 08 16:40:14.833210 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:14.833199    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d63e3376-02b0-4ad3-b155-0022cf76d0ee" path="/var/lib/kubelet/pods/d63e3376-02b0-4ad3-b155-0022cf76d0ee/volumes"
Sep 08 16:40:15.725451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:15.725417    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69986476d6-hqpcj" event={"ID":"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506","Type":"ContainerStarted","Data":"c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37"}
Sep 08 16:40:15.739691 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:15.739638    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-69986476d6-hqpcj" podStartSLOduration=1.8852254130000001 podStartE2EDuration="2.73962301s" totalImagesPullingTime="854.397597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:15.737947223 +0000 UTC m=+611.441790219" watchObservedRunningTime="2026-09-08 16:40:15.73962301 +0000 UTC m=+611.443466010"
Sep 08 16:40:15.765527 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:15.765494    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qct7"]
Sep 08 16:40:15.765686 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:15.765668    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-7qct7" podUID="5ba28c84-e073-4467-a0b8-becb50608c54" containerName="authorino" containerID="cri-o://f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8" gracePeriod=30
Sep 08 16:40:16.004803 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.004765    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:40:16.125120 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.125080    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76zz9\" (UniqueName: \"kubernetes.io/projected/5ba28c84-e073-4467-a0b8-becb50608c54-kube-api-access-76zz9\") pod \"5ba28c84-e073-4467-a0b8-becb50608c54\" (UID: \"5ba28c84-e073-4467-a0b8-becb50608c54\") "
Sep 08 16:40:16.127341 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.127309    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba28c84-e073-4467-a0b8-becb50608c54-kube-api-access-76zz9" (OuterVolumeSpecName: "kube-api-access-76zz9") pod "5ba28c84-e073-4467-a0b8-becb50608c54" (UID: "5ba28c84-e073-4467-a0b8-becb50608c54"). InnerVolumeSpecName "kube-api-access-76zz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:40:16.226549 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.226520    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76zz9\" (UniqueName: \"kubernetes.io/projected/5ba28c84-e073-4467-a0b8-becb50608c54-kube-api-access-76zz9\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:16.732247 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.732211    2547 generic.go:356] "Generic (PLEG): container finished" podID="5ba28c84-e073-4467-a0b8-becb50608c54" containerID="f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8" exitCode=0
Sep 08 16:40:16.732669 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.732264    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-7qct7"
Sep 08 16:40:16.732669 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.732302    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qct7" event={"ID":"5ba28c84-e073-4467-a0b8-becb50608c54","Type":"ContainerDied","Data":"f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8"}
Sep 08 16:40:16.732669 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.732340    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-7qct7" event={"ID":"5ba28c84-e073-4467-a0b8-becb50608c54","Type":"ContainerDied","Data":"07e72285577d57ebd2fb30456b7fd4c80051f713606f518390e41454dc5964be"}
Sep 08 16:40:16.732669 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.732357    2547 scope.go:117] "RemoveContainer" containerID="f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8"
Sep 08 16:40:16.741489 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.741475    2547 scope.go:117] "RemoveContainer" containerID="f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8"
Sep 08 16:40:16.741753 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:40:16.741735    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8\": container with ID starting with f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8 not found: ID does not exist" containerID="f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8"
Sep 08 16:40:16.741825 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.741763    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8"} err="failed to get container status \"f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8\": rpc error: code = NotFound desc = could not find container \"f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8\": container with ID starting with f5972f64c10ff1147b43d9e3d46cd71bc21d34cc39d1e7d18698d930c4bd56d8 not found: ID does not exist"
Sep 08 16:40:16.752140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.752107    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qct7"]
Sep 08 16:40:16.755659 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.755642    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-7qct7"]
Sep 08 16:40:16.832350 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:16.832309    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba28c84-e073-4467-a0b8-becb50608c54" path="/var/lib/kubelet/pods/5ba28c84-e073-4467-a0b8-becb50608c54/volumes"
Sep 08 16:40:20.491731 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.491697    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-674d6c5485-zfg9g"]
Sep 08 16:40:20.492094 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.492044    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba28c84-e073-4467-a0b8-becb50608c54" containerName="authorino"
Sep 08 16:40:20.492094 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.492057    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba28c84-e073-4467-a0b8-becb50608c54" containerName="authorino"
Sep 08 16:40:20.492196 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.492121    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba28c84-e073-4467-a0b8-becb50608c54" containerName="authorino"
Sep 08 16:40:20.496575 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.496557    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.498981 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.498959    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 16:40:20.498981 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.498972    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 16:40:20.499109 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.498987    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8sc6g\""
Sep 08 16:40:20.499621 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.499602    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 16:40:20.507385 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.507365    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674d6c5485-zfg9g"]
Sep 08 16:40:20.564937 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.564900    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swg4f\" (UniqueName: \"kubernetes.io/projected/fe070809-e4ed-4d29-ac24-d885580af00b-kube-api-access-swg4f\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.565136 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.564961    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-metrics-certs\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.565136 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.565041    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.666428 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.666394    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-metrics-certs\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.666620 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.666441    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.666620 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.666486    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swg4f\" (UniqueName: \"kubernetes.io/projected/fe070809-e4ed-4d29-ac24-d885580af00b-kube-api-access-swg4f\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.666736 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:40:20.666625    2547 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 08 16:40:20.666736 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:40:20.666703    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert podName:fe070809-e4ed-4d29-ac24-d885580af00b nodeName:}" failed. No retries permitted until 2026-09-08 16:40:21.166679847 +0000 UTC m=+616.870522827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert") pod "maas-controller-674d6c5485-zfg9g" (UID: "fe070809-e4ed-4d29-ac24-d885580af00b") : secret "maas-controller-webhook-cert" not found
Sep 08 16:40:20.669132 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.669112    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-metrics-certs\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:20.678643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:20.678623    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swg4f\" (UniqueName: \"kubernetes.io/projected/fe070809-e4ed-4d29-ac24-d885580af00b-kube-api-access-swg4f\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:21.171051 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:21.170997    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:21.173577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:21.173549    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert\") pod \"maas-controller-674d6c5485-zfg9g\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") " pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:21.407416 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:21.407376    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:21.683191 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:21.683145    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-674d6c5485-zfg9g"]
Sep 08 16:40:21.688580 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:40:21.688552    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe070809_e4ed_4d29_ac24_d885580af00b.slice/crio-359446a2c7b8a92c76c0a4153077d4085650802d115ad4d8db929beca95bd7db WatchSource:0}: Error finding container 359446a2c7b8a92c76c0a4153077d4085650802d115ad4d8db929beca95bd7db: Status 404 returned error can't find the container with id 359446a2c7b8a92c76c0a4153077d4085650802d115ad4d8db929beca95bd7db
Sep 08 16:40:21.759457 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:21.759373    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674d6c5485-zfg9g" event={"ID":"fe070809-e4ed-4d29-ac24-d885580af00b","Type":"ContainerStarted","Data":"359446a2c7b8a92c76c0a4153077d4085650802d115ad4d8db929beca95bd7db"}
Sep 08 16:40:23.774362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:23.774325    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674d6c5485-zfg9g" event={"ID":"fe070809-e4ed-4d29-ac24-d885580af00b","Type":"ContainerStarted","Data":"68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e"}
Sep 08 16:40:23.774895 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:23.774458    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:23.796260 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:23.796210    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-674d6c5485-zfg9g" podStartSLOduration=2.216942847 podStartE2EDuration="3.796194227s" totalImagesPullingTime="1.57925138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:23.794066043 +0000 UTC m=+619.497909080" watchObservedRunningTime="2026-09-08 16:40:23.796194227 +0000 UTC m=+619.500037227"
Sep 08 16:40:34.782588 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:34.782553    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:35.478274 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.478242    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674d6c5485-zfg9g"]
Sep 08 16:40:35.478452 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.478427    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-674d6c5485-zfg9g" podUID="fe070809-e4ed-4d29-ac24-d885580af00b" containerName="manager" containerID="cri-o://68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e" gracePeriod=30
Sep 08 16:40:35.725547 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.725519    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:35.838567 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.838531    2547 generic.go:356] "Generic (PLEG): container finished" podID="fe070809-e4ed-4d29-ac24-d885580af00b" containerID="68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e" exitCode=0
Sep 08 16:40:35.838986 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.838578    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-674d6c5485-zfg9g"
Sep 08 16:40:35.838986 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.838600    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674d6c5485-zfg9g" event={"ID":"fe070809-e4ed-4d29-ac24-d885580af00b","Type":"ContainerDied","Data":"68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e"}
Sep 08 16:40:35.838986 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.838646    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-674d6c5485-zfg9g" event={"ID":"fe070809-e4ed-4d29-ac24-d885580af00b","Type":"ContainerDied","Data":"359446a2c7b8a92c76c0a4153077d4085650802d115ad4d8db929beca95bd7db"}
Sep 08 16:40:35.838986 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.838674    2547 scope.go:117] "RemoveContainer" containerID="68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e"
Sep 08 16:40:35.847924 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.847906    2547 scope.go:117] "RemoveContainer" containerID="68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e"
Sep 08 16:40:35.848174 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:40:35.848157    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e\": container with ID starting with 68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e not found: ID does not exist" containerID="68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e"
Sep 08 16:40:35.848230 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.848184    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e"} err="failed to get container status \"68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e\": rpc error: code = NotFound desc = could not find container \"68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e\": container with ID starting with 68b91f35b400c6b04b279882d2ae99b844dfe6ca1b76fded99479d2511e8738e not found: ID does not exist"
Sep 08 16:40:35.901511 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.901476    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swg4f\" (UniqueName: \"kubernetes.io/projected/fe070809-e4ed-4d29-ac24-d885580af00b-kube-api-access-swg4f\") pod \"fe070809-e4ed-4d29-ac24-d885580af00b\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") "
Sep 08 16:40:35.901653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.901525    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert\") pod \"fe070809-e4ed-4d29-ac24-d885580af00b\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") "
Sep 08 16:40:35.901653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.901550    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-metrics-certs\") pod \"fe070809-e4ed-4d29-ac24-d885580af00b\" (UID: \"fe070809-e4ed-4d29-ac24-d885580af00b\") "
Sep 08 16:40:35.903979 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.903943    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe070809-e4ed-4d29-ac24-d885580af00b-kube-api-access-swg4f" (OuterVolumeSpecName: "kube-api-access-swg4f") pod "fe070809-e4ed-4d29-ac24-d885580af00b" (UID: "fe070809-e4ed-4d29-ac24-d885580af00b"). InnerVolumeSpecName "kube-api-access-swg4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:40:35.904088 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.903996    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fe070809-e4ed-4d29-ac24-d885580af00b" (UID: "fe070809-e4ed-4d29-ac24-d885580af00b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:40:35.904088 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:35.904012    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fe070809-e4ed-4d29-ac24-d885580af00b" (UID: "fe070809-e4ed-4d29-ac24-d885580af00b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:40:36.003096 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:36.003064    2547 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-webhook-cert\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:36.003096 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:36.003096    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe070809-e4ed-4d29-ac24-d885580af00b-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:36.003303 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:36.003119    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swg4f\" (UniqueName: \"kubernetes.io/projected/fe070809-e4ed-4d29-ac24-d885580af00b-kube-api-access-swg4f\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:40:36.160129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:36.160097    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-674d6c5485-zfg9g"]
Sep 08 16:40:36.163680 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:36.163653    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-674d6c5485-zfg9g"]
Sep 08 16:40:36.833344 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:36.833311    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe070809-e4ed-4d29-ac24-d885580af00b" path="/var/lib/kubelet/pods/fe070809-e4ed-4d29-ac24-d885580af00b/volumes"
Sep 08 16:40:58.569335 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.569293    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"]
Sep 08 16:40:58.569834 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.569798    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe070809-e4ed-4d29-ac24-d885580af00b" containerName="manager"
Sep 08 16:40:58.569834 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.569817    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe070809-e4ed-4d29-ac24-d885580af00b" containerName="manager"
Sep 08 16:40:58.569973 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.569924    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe070809-e4ed-4d29-ac24-d885580af00b" containerName="manager"
Sep 08 16:40:58.572971 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.572950    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.575195 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.575159    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2xqfl\""
Sep 08 16:40:58.575303 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.575271    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 16:40:58.584515 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.584489    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"]
Sep 08 16:40:58.683404 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.683372    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5mxz\" (UniqueName: \"kubernetes.io/projected/159ee2ab-6424-4294-80a7-440298e1ad38-kube-api-access-d5mxz\") pod \"payload-pre-processing-59fbc47bf8-pj92q\" (UID: \"159ee2ab-6424-4294-80a7-440298e1ad38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.683404 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.683414    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/159ee2ab-6424-4294-80a7-440298e1ad38-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pj92q\" (UID: \"159ee2ab-6424-4294-80a7-440298e1ad38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.784143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.784110    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5mxz\" (UniqueName: \"kubernetes.io/projected/159ee2ab-6424-4294-80a7-440298e1ad38-kube-api-access-d5mxz\") pod \"payload-pre-processing-59fbc47bf8-pj92q\" (UID: \"159ee2ab-6424-4294-80a7-440298e1ad38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.784143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.784142    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/159ee2ab-6424-4294-80a7-440298e1ad38-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pj92q\" (UID: \"159ee2ab-6424-4294-80a7-440298e1ad38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.784901 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.784875    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/159ee2ab-6424-4294-80a7-440298e1ad38-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-pj92q\" (UID: \"159ee2ab-6424-4294-80a7-440298e1ad38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.793107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.793079    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5mxz\" (UniqueName: \"kubernetes.io/projected/159ee2ab-6424-4294-80a7-440298e1ad38-kube-api-access-d5mxz\") pod \"payload-pre-processing-59fbc47bf8-pj92q\" (UID: \"159ee2ab-6424-4294-80a7-440298e1ad38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:58.883088 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:58.883005    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:40:59.163242 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:59.163217    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"]
Sep 08 16:40:59.165494 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:40:59.165467    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod159ee2ab_6424_4294_80a7_440298e1ad38.slice/crio-53c158b059c0c87cecc1811f22ad753155136b51db344cd961d16e8897e2f2ae WatchSource:0}: Error finding container 53c158b059c0c87cecc1811f22ad753155136b51db344cd961d16e8897e2f2ae: Status 404 returned error can't find the container with id 53c158b059c0c87cecc1811f22ad753155136b51db344cd961d16e8897e2f2ae
Sep 08 16:40:59.167830 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:59.167813    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:40:59.973549 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:40:59.973506    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q" event={"ID":"159ee2ab-6424-4294-80a7-440298e1ad38","Type":"ContainerStarted","Data":"53c158b059c0c87cecc1811f22ad753155136b51db344cd961d16e8897e2f2ae"}
Sep 08 16:41:00.983238 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:00.983185    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q" event={"ID":"159ee2ab-6424-4294-80a7-440298e1ad38","Type":"ContainerStarted","Data":"5c7e096d14b95405dfe75caffd82380aad54247f2fa8c329315d363bedda1017"}
Sep 08 16:41:00.983671 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:00.983298    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:41:01.000540 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:01.000495    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q" podStartSLOduration=1.352389041 podStartE2EDuration="3.000479024s" totalImagesPullingTime="1.648089983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:00.999272089 +0000 UTC m=+656.703115092" watchObservedRunningTime="2026-09-08 16:41:01.000479024 +0000 UTC m=+656.704322024"
Sep 08 16:41:11.991148 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:11.991110    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-pj92q"
Sep 08 16:41:16.233183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.233148    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"]
Sep 08 16:41:16.238289 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.238266    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.241345 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.241322    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 08 16:41:16.241345 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.241336    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 16:41:16.241540 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.241322    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 16:41:16.241540 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.241391    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zk588\""
Sep 08 16:41:16.247287 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.247267    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"]
Sep 08 16:41:16.333160 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.333119    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30311391-a03d-4830-ac94-1125a8513266-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.333160 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.333170    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.333425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.333238    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.333425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.333314    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.333425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.333339    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.333535 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.333431    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7jg5\" (UniqueName: \"kubernetes.io/projected/30311391-a03d-4830-ac94-1125a8513266-kube-api-access-r7jg5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.434452 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.434417    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30311391-a03d-4830-ac94-1125a8513266-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.434660 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.434460    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.434660 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.434484    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.434660 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.434508    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.434660 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.434523    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.434932 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.434662    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7jg5\" (UniqueName: \"kubernetes.io/projected/30311391-a03d-4830-ac94-1125a8513266-kube-api-access-r7jg5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.435063 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.435039    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.435107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.435080    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.435145 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.435132    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.437026 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.437002    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30311391-a03d-4830-ac94-1125a8513266-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.437308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.437292    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30311391-a03d-4830-ac94-1125a8513266-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.444221 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.444198    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7jg5\" (UniqueName: \"kubernetes.io/projected/30311391-a03d-4830-ac94-1125a8513266-kube-api-access-r7jg5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks\" (UID: \"30311391-a03d-4830-ac94-1125a8513266\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.550751 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.550710    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:16.825666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:16.825641    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"]
Sep 08 16:41:16.829127 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:41:16.829052    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30311391_a03d_4830_ac94_1125a8513266.slice/crio-7923cd2e2687b24732cebe20887cfc0f3f783377c3b1fd94117e8fe519b0271a WatchSource:0}: Error finding container 7923cd2e2687b24732cebe20887cfc0f3f783377c3b1fd94117e8fe519b0271a: Status 404 returned error can't find the container with id 7923cd2e2687b24732cebe20887cfc0f3f783377c3b1fd94117e8fe519b0271a
Sep 08 16:41:17.073539 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:17.073495    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks" event={"ID":"30311391-a03d-4830-ac94-1125a8513266","Type":"ContainerStarted","Data":"7923cd2e2687b24732cebe20887cfc0f3f783377c3b1fd94117e8fe519b0271a"}
Sep 08 16:41:18.081138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:18.081107    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks" event={"ID":"30311391-a03d-4830-ac94-1125a8513266","Type":"ContainerStarted","Data":"9193899a6428e16712e6faa5f0b50ae2c706bf2ccbcb9991f5a4e060cf54dad2"}
Sep 08 16:41:18.100173 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:18.100118    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks" podStartSLOduration=0.940190883 podStartE2EDuration="2.100102598s" totalImagesPullingTime="1.159911715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:18.098332672 +0000 UTC m=+673.802175672" watchObservedRunningTime="2026-09-08 16:41:18.100102598 +0000 UTC m=+673.803945597"
Sep 08 16:41:26.551267 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:26.551221    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:26.551684 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:26.551300    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:26.564000 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:26.563967    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:27.138736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:27.138709    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks"
Sep 08 16:41:30.823635 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.823598    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"]
Sep 08 16:41:30.827284 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.827255    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:30.829499 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.829475    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 16:41:30.836989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.836962    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"]
Sep 08 16:41:30.960486 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.960448    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:30.960664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.960499    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vhdl\" (UniqueName: \"kubernetes.io/projected/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-kube-api-access-4vhdl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:30.960664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.960576    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:30.960664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.960629    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:30.960664 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.960660    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:30.960824 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:30.960678    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.061831 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.061763    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062006 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.061863    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062006 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.061899    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062006 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.061991    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062137 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.062049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062137 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.062105    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vhdl\" (UniqueName: \"kubernetes.io/projected/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-kube-api-access-4vhdl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062235 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.062161    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062292 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.062241    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.062418 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.062397    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.064332 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.064309    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.064549 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.064531    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.070002 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.069980    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vhdl\" (UniqueName: \"kubernetes.io/projected/1ee1c887-bebf-4914-9da1-6b6a0f82b5d3-kube-api-access-4vhdl\") pod \"e2e-distinct-simulated-kserve-59975d69f9-kcs6m\" (UID: \"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.139603 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.139509    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:31.415934 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:31.415909    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"]
Sep 08 16:41:31.417718 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:41:31.417691    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee1c887_bebf_4914_9da1_6b6a0f82b5d3.slice/crio-d49b35a9a5e764dc92d0776c9c9a0f067d612da4be31da66be7f283849e8f352 WatchSource:0}: Error finding container d49b35a9a5e764dc92d0776c9c9a0f067d612da4be31da66be7f283849e8f352: Status 404 returned error can't find the container with id d49b35a9a5e764dc92d0776c9c9a0f067d612da4be31da66be7f283849e8f352
Sep 08 16:41:32.157918 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:32.157879    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m" event={"ID":"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3","Type":"ContainerStarted","Data":"5fb36b03414357ad86b2de097ee0098d7265abb2b61a06dc91b1876fe7c3d979"}
Sep 08 16:41:32.158285 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:32.157934    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m" event={"ID":"1ee1c887-bebf-4914-9da1-6b6a0f82b5d3","Type":"ContainerStarted","Data":"d49b35a9a5e764dc92d0776c9c9a0f067d612da4be31da66be7f283849e8f352"}
Sep 08 16:41:32.175732 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:32.175685    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m" podStartSLOduration=1.963461428 podStartE2EDuration="2.175669637s" totalImagesPullingTime="212.208209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:32.174537597 +0000 UTC m=+687.878380599" watchObservedRunningTime="2026-09-08 16:41:32.175669637 +0000 UTC m=+687.879512637"
Sep 08 16:41:41.140133 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:41.140086    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:41.140577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:41.140175    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:41.152763 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:41.152732    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:41.215047 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:41.215016    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-kcs6m"
Sep 08 16:41:45.725254 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.725221    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"]
Sep 08 16:41:45.729457 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.729437    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.732120 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.732091    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 16:41:45.741205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.741183    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"]
Sep 08 16:41:45.792603 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.792566    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/249b124f-848d-4bf8-8084-4870090f9eba-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.792891 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.792628    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.792891 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.792648    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.792891 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.792672    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rltg\" (UniqueName: \"kubernetes.io/projected/249b124f-848d-4bf8-8084-4870090f9eba-kube-api-access-5rltg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.792891 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.792698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.792891 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.792750    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893269 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893232    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893269 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893276    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/249b124f-848d-4bf8-8084-4870090f9eba-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893316    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893330    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893356    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rltg\" (UniqueName: \"kubernetes.io/projected/249b124f-848d-4bf8-8084-4870090f9eba-kube-api-access-5rltg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893485 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893376    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893724 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893702    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893724 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893717    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.893840 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.893814    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.895775 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.895756    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/249b124f-848d-4bf8-8084-4870090f9eba-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.896070 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.896052    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/249b124f-848d-4bf8-8084-4870090f9eba-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:45.900572 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:45.900550    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rltg\" (UniqueName: \"kubernetes.io/projected/249b124f-848d-4bf8-8084-4870090f9eba-kube-api-access-5rltg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-m9mtq\" (UID: \"249b124f-848d-4bf8-8084-4870090f9eba\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:46.040390 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:46.040361    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:46.319459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:46.316098    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"]
Sep 08 16:41:46.321049 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:41:46.321017    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249b124f_848d_4bf8_8084_4870090f9eba.slice/crio-35cabb72a88afb76c4223c3def0b86c4b86b6c98efe3365ac73dc617e378041f WatchSource:0}: Error finding container 35cabb72a88afb76c4223c3def0b86c4b86b6c98efe3365ac73dc617e378041f: Status 404 returned error can't find the container with id 35cabb72a88afb76c4223c3def0b86c4b86b6c98efe3365ac73dc617e378041f
Sep 08 16:41:47.236405 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:47.236362    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq" event={"ID":"249b124f-848d-4bf8-8084-4870090f9eba","Type":"ContainerStarted","Data":"5567f59c1c954388829c496f8f1ab20eed89afec2a5dd0f2b86b3f3a0389ebf3"}
Sep 08 16:41:47.236913 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:47.236422    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq" event={"ID":"249b124f-848d-4bf8-8084-4870090f9eba","Type":"ContainerStarted","Data":"35cabb72a88afb76c4223c3def0b86c4b86b6c98efe3365ac73dc617e378041f"}
Sep 08 16:41:47.255848 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:47.255775    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq" podStartSLOduration=2.036584486 podStartE2EDuration="2.255759618s" totalImagesPullingTime="219.175132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:47.25424737 +0000 UTC m=+702.958090371" watchObservedRunningTime="2026-09-08 16:41:47.255759618 +0000 UTC m=+702.959602635"
Sep 08 16:41:56.041158 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:56.041070    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:56.041158 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:56.041140    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:56.054194 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:56.054168    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:41:56.297887 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:41:56.297799    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-m9mtq"
Sep 08 16:42:01.430067 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.430038    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"]
Sep 08 16:42:01.433471 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.433455    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.435823 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.435769    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 08 16:42:01.444205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.444177    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"]
Sep 08 16:42:01.528648 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.528613    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.528862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.528655    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.528862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.528676    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7120855d-0caa-40b7-941f-67356ee2713e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.528862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.528693    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z859s\" (UniqueName: \"kubernetes.io/projected/7120855d-0caa-40b7-941f-67356ee2713e-kube-api-access-z859s\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.528862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.528811    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.528862 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.528841    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629425    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629472    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629680 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629491    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7120855d-0caa-40b7-941f-67356ee2713e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629721 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629691    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z859s\" (UniqueName: \"kubernetes.io/projected/7120855d-0caa-40b7-941f-67356ee2713e-kube-api-access-z859s\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629869 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629849    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629937 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629883    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.629937 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629908    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.630045 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.629996    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.630097 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.630080    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.632120 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.632093    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7120855d-0caa-40b7-941f-67356ee2713e-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.632236 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.632154    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7120855d-0caa-40b7-941f-67356ee2713e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.637229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.637206    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z859s\" (UniqueName: \"kubernetes.io/projected/7120855d-0caa-40b7-941f-67356ee2713e-kube-api-access-z859s\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl\" (UID: \"7120855d-0caa-40b7-941f-67356ee2713e\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:01.743571 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:01.743481    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:02.016156 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:02.016127    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"]
Sep 08 16:42:02.017256 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:42:02.017233    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7120855d_0caa_40b7_941f_67356ee2713e.slice/crio-6d870aec366799303e90c0ba076685ed74ea552da47427bf77cece995034fa20 WatchSource:0}: Error finding container 6d870aec366799303e90c0ba076685ed74ea552da47427bf77cece995034fa20: Status 404 returned error can't find the container with id 6d870aec366799303e90c0ba076685ed74ea552da47427bf77cece995034fa20
Sep 08 16:42:02.321723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:02.321688    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl" event={"ID":"7120855d-0caa-40b7-941f-67356ee2713e","Type":"ContainerStarted","Data":"97832b0e9e0d9461edbc17f6bfa396420e5c1598a09210dafbdb8d04d9e4e69c"}
Sep 08 16:42:02.321723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:02.321734    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl" event={"ID":"7120855d-0caa-40b7-941f-67356ee2713e","Type":"ContainerStarted","Data":"6d870aec366799303e90c0ba076685ed74ea552da47427bf77cece995034fa20"}
Sep 08 16:42:02.340482 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:02.340424    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl" podStartSLOduration=1.1369076599999999 podStartE2EDuration="1.340409403s" totalImagesPullingTime="203.501743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:42:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:42:02.33702861 +0000 UTC m=+718.040871611" watchObservedRunningTime="2026-09-08 16:42:02.340409403 +0000 UTC m=+718.044252403"
Sep 08 16:42:11.743906 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:11.743860    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:11.743906 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:11.743909    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:11.756572 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:11.756548    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:12.386026 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:12.385991    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl"
Sep 08 16:42:58.487253 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.487215    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f999b88d7-x52gs"]
Sep 08 16:42:58.490800 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.490764    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.497262 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.497234    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f999b88d7-x52gs"]
Sep 08 16:42:58.508972 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.508945    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697j7\" (UniqueName: \"kubernetes.io/projected/bd9a2722-d87f-49ea-b35d-c250ed11db2c-kube-api-access-697j7\") pod \"authorino-5f999b88d7-x52gs\" (UID: \"bd9a2722-d87f-49ea-b35d-c250ed11db2c\") " pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.509108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.508994    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd9a2722-d87f-49ea-b35d-c250ed11db2c-tls-cert\") pod \"authorino-5f999b88d7-x52gs\" (UID: \"bd9a2722-d87f-49ea-b35d-c250ed11db2c\") " pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.609449 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.609408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-697j7\" (UniqueName: \"kubernetes.io/projected/bd9a2722-d87f-49ea-b35d-c250ed11db2c-kube-api-access-697j7\") pod \"authorino-5f999b88d7-x52gs\" (UID: \"bd9a2722-d87f-49ea-b35d-c250ed11db2c\") " pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.609632 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.609460    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd9a2722-d87f-49ea-b35d-c250ed11db2c-tls-cert\") pod \"authorino-5f999b88d7-x52gs\" (UID: \"bd9a2722-d87f-49ea-b35d-c250ed11db2c\") " pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.612018 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.611995    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd9a2722-d87f-49ea-b35d-c250ed11db2c-tls-cert\") pod \"authorino-5f999b88d7-x52gs\" (UID: \"bd9a2722-d87f-49ea-b35d-c250ed11db2c\") " pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.617927 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.617904    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-697j7\" (UniqueName: \"kubernetes.io/projected/bd9a2722-d87f-49ea-b35d-c250ed11db2c-kube-api-access-697j7\") pod \"authorino-5f999b88d7-x52gs\" (UID: \"bd9a2722-d87f-49ea-b35d-c250ed11db2c\") " pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:58.800447 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:58.800399    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f999b88d7-x52gs"
Sep 08 16:42:59.071270 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:59.071246    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f999b88d7-x52gs"]
Sep 08 16:42:59.073110 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:42:59.073080    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd9a2722_d87f_49ea_b35d_c250ed11db2c.slice/crio-7d9007fd8915f4de917570952fdcef0743b6c7f91332ceda50dfeb57d3a75fcc WatchSource:0}: Error finding container 7d9007fd8915f4de917570952fdcef0743b6c7f91332ceda50dfeb57d3a75fcc: Status 404 returned error can't find the container with id 7d9007fd8915f4de917570952fdcef0743b6c7f91332ceda50dfeb57d3a75fcc
Sep 08 16:42:59.625706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:42:59.625670    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f999b88d7-x52gs" event={"ID":"bd9a2722-d87f-49ea-b35d-c250ed11db2c","Type":"ContainerStarted","Data":"7d9007fd8915f4de917570952fdcef0743b6c7f91332ceda50dfeb57d3a75fcc"}
Sep 08 16:43:00.634043 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:00.634007    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f999b88d7-x52gs" event={"ID":"bd9a2722-d87f-49ea-b35d-c250ed11db2c","Type":"ContainerStarted","Data":"95bdd14cf9a054625bab5a5054d21fbec0e5d86c27b5dd156c1b9f7b4d10241c"}
Sep 08 16:43:00.652943 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:00.652854    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f999b88d7-x52gs" podStartSLOduration=1.8281366380000001 podStartE2EDuration="2.652834342s" totalImagesPullingTime="824.697704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:00.65224731 +0000 UTC m=+776.356090308" watchObservedRunningTime="2026-09-08 16:43:00.652834342 +0000 UTC m=+776.356677342"
Sep 08 16:43:00.687606 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:00.687559    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69986476d6-hqpcj"]
Sep 08 16:43:00.688305 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:00.688050    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-69986476d6-hqpcj" podUID="ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" containerName="authorino" containerID="cri-o://c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37" gracePeriod=30
Sep 08 16:43:00.959903 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:00.959877    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:43:01.026036 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.025997    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-tls-cert\") pod \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") "
Sep 08 16:43:01.026036 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.026036    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk96c\" (UniqueName: \"kubernetes.io/projected/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-kube-api-access-hk96c\") pod \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\" (UID: \"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506\") "
Sep 08 16:43:01.028612 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.028578    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-kube-api-access-hk96c" (OuterVolumeSpecName: "kube-api-access-hk96c") pod "ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" (UID: "ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506"). InnerVolumeSpecName "kube-api-access-hk96c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:43:01.037451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.037418    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" (UID: "ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:43:01.126987 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.126952    2547 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-tls-cert\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:43:01.126987 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.126984    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk96c\" (UniqueName: \"kubernetes.io/projected/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506-kube-api-access-hk96c\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:43:01.641222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.641179    2547 generic.go:356] "Generic (PLEG): container finished" podID="ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" containerID="c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37" exitCode=0
Sep 08 16:43:01.641222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.641217    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-69986476d6-hqpcj"
Sep 08 16:43:01.641767 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.641257    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69986476d6-hqpcj" event={"ID":"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506","Type":"ContainerDied","Data":"c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37"}
Sep 08 16:43:01.641767 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.641300    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-69986476d6-hqpcj" event={"ID":"ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506","Type":"ContainerDied","Data":"5b6fa4496c69f680a2bccd934837da79c398c3f3969a5759efa6872ad5b7aa96"}
Sep 08 16:43:01.641767 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.641325    2547 scope.go:117] "RemoveContainer" containerID="c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37"
Sep 08 16:43:01.651442 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.651423    2547 scope.go:117] "RemoveContainer" containerID="c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37"
Sep 08 16:43:01.651747 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:43:01.651726    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37\": container with ID starting with c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37 not found: ID does not exist" containerID="c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37"
Sep 08 16:43:01.651860 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.651754    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37"} err="failed to get container status \"c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37\": rpc error: code = NotFound desc = could not find container \"c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37\": container with ID starting with c3c33a20a7bf0a35ef9ac16da3a0c2ebf2344540c9a61727f875f932f3deed37 not found: ID does not exist"
Sep 08 16:43:01.664101 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.664053    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-69986476d6-hqpcj"]
Sep 08 16:43:01.667742 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:01.667718    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-69986476d6-hqpcj"]
Sep 08 16:43:02.832529 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:02.832494    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" path="/var/lib/kubelet/pods/ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506/volumes"
Sep 08 16:43:31.107995 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.107908    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"]
Sep 08 16:43:31.108426 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.108268    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" containerName="authorino"
Sep 08 16:43:31.108426 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.108279    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" containerName="authorino"
Sep 08 16:43:31.108426 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.108349    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2ca84a-4b42-4d00-9b0c-7dfeb5aaa506" containerName="authorino"
Sep 08 16:43:31.111517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.111497    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.114083 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.114061    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4c81c932-serving-cert\""
Sep 08 16:43:31.114863 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.114845    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dzvtd\""
Sep 08 16:43:31.114863 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.114854    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 16:43:31.121624 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.121603    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"]
Sep 08 16:43:31.196809 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.196740    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.196809 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.196816    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-metrics-certs\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.197039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.196835    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxpwh\" (UniqueName: \"kubernetes.io/projected/eeeeef05-2e71-47c2-8f32-d26751579fa6-kube-api-access-rxpwh\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.197039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.196873    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeef05-2e71-47c2-8f32-d26751579fa6-openshift-service-ca\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.298048 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.298012    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeef05-2e71-47c2-8f32-d26751579fa6-openshift-service-ca\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.298248 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.298088    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.298248 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.298106    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-metrics-certs\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.298248 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.298120    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxpwh\" (UniqueName: \"kubernetes.io/projected/eeeeef05-2e71-47c2-8f32-d26751579fa6-kube-api-access-rxpwh\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.298431 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:43:31.298249    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-serving-cert: secret "maas-api-e2e-ait-4c81c932-serving-cert" not found
Sep 08 16:43:31.298431 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:43:31.298341    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls podName:eeeeef05-2e71-47c2-8f32-d26751579fa6 nodeName:}" failed. No retries permitted until 2026-09-08 16:43:31.79831888 +0000 UTC m=+807.502161872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls") pod "maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" (UID: "eeeeef05-2e71-47c2-8f32-d26751579fa6") : secret "maas-api-e2e-ait-4c81c932-serving-cert" not found
Sep 08 16:43:31.298811 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.298764    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeef05-2e71-47c2-8f32-d26751579fa6-openshift-service-ca\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.300646 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.300628    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-metrics-certs\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.309509 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.309486    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxpwh\" (UniqueName: \"kubernetes.io/projected/eeeeef05-2e71-47c2-8f32-d26751579fa6-kube-api-access-rxpwh\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.803000 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.802964    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:31.805771 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:31.805746    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls\") pod \"maas-api-e2e-ait-4c81c932-55fb5846c4-jx967\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:32.024465 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.024431    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:32.299015 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.298984    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"]
Sep 08 16:43:32.300475 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:43:32.300448    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeeeef05_2e71_47c2_8f32_d26751579fa6.slice/crio-8ef9145a03a6e1a94c3d3ac07b31a15f257e36f2e2a4a3337884fb022ab6514c WatchSource:0}: Error finding container 8ef9145a03a6e1a94c3d3ac07b31a15f257e36f2e2a4a3337884fb022ab6514c: Status 404 returned error can't find the container with id 8ef9145a03a6e1a94c3d3ac07b31a15f257e36f2e2a4a3337884fb022ab6514c
Sep 08 16:43:32.475520 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.475435    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"]
Sep 08 16:43:32.480460 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.480433    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.482719 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.482695    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-4cea93-serving-cert\""
Sep 08 16:43:32.488292 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.488270    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"]
Sep 08 16:43:32.611522 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.611486    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6grt2\" (UniqueName: \"kubernetes.io/projected/69457727-f4bc-4400-a785-cd664bed1b74-kube-api-access-6grt2\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.611724 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.611561    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-maas-api-tls\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.611724 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.611615    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69457727-f4bc-4400-a785-cd664bed1b74-openshift-service-ca\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.611724 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.611639    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-metrics-certs\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.712695 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.712659    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69457727-f4bc-4400-a785-cd664bed1b74-openshift-service-ca\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.712695 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.712696    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-metrics-certs\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.712944 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.712757    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6grt2\" (UniqueName: \"kubernetes.io/projected/69457727-f4bc-4400-a785-cd664bed1b74-kube-api-access-6grt2\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.712944 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.712831    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-maas-api-tls\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.713301 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.713277    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69457727-f4bc-4400-a785-cd664bed1b74-openshift-service-ca\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.715396 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.715372    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-maas-api-tls\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.715489 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.715392    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-metrics-certs\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.721322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.721303    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6grt2\" (UniqueName: \"kubernetes.io/projected/69457727-f4bc-4400-a785-cd664bed1b74-kube-api-access-6grt2\") pod \"maas-api-e2e-autores-4cea93-79f8f49f-57p7z\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.794263 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.794221    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:32.816155 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:32.816125    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" event={"ID":"eeeeef05-2e71-47c2-8f32-d26751579fa6","Type":"ContainerStarted","Data":"8ef9145a03a6e1a94c3d3ac07b31a15f257e36f2e2a4a3337884fb022ab6514c"}
Sep 08 16:43:33.075706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:33.075675    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"]
Sep 08 16:43:33.077225 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:43:33.077188    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69457727_f4bc_4400_a785_cd664bed1b74.slice/crio-ed3508bf2d21ff96311ef968ab0c8cc59d4545c7b99d64ea42a8b9b1710713c7 WatchSource:0}: Error finding container ed3508bf2d21ff96311ef968ab0c8cc59d4545c7b99d64ea42a8b9b1710713c7: Status 404 returned error can't find the container with id ed3508bf2d21ff96311ef968ab0c8cc59d4545c7b99d64ea42a8b9b1710713c7
Sep 08 16:43:33.826407 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:33.826369    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z" event={"ID":"69457727-f4bc-4400-a785-cd664bed1b74","Type":"ContainerStarted","Data":"ed3508bf2d21ff96311ef968ab0c8cc59d4545c7b99d64ea42a8b9b1710713c7"}
Sep 08 16:43:34.833938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:34.833902    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z" event={"ID":"69457727-f4bc-4400-a785-cd664bed1b74","Type":"ContainerStarted","Data":"cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f"}
Sep 08 16:43:34.834410 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:34.834122    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:34.835546 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:34.835523    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" event={"ID":"eeeeef05-2e71-47c2-8f32-d26751579fa6","Type":"ContainerStarted","Data":"579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9"}
Sep 08 16:43:34.835671 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:34.835641    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:34.853852 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:34.853804    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z" podStartSLOduration=1.783967054 podStartE2EDuration="2.853791218s" totalImagesPullingTime="1.069824164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:34.851603077 +0000 UTC m=+810.555446090" watchObservedRunningTime="2026-09-08 16:43:34.853791218 +0000 UTC m=+810.557634209"
Sep 08 16:43:34.871319 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:34.871261    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" podStartSLOduration=2.027160743 podStartE2EDuration="3.871247439s" totalImagesPullingTime="1.844086696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:34.86996017 +0000 UTC m=+810.573803171" watchObservedRunningTime="2026-09-08 16:43:34.871247439 +0000 UTC m=+810.575090438"
Sep 08 16:43:40.846966 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:40.846939    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:43:40.847376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:40.847358    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:43:51.710357 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.710325    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"]
Sep 08 16:43:51.715988 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.715966    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.718323 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.718297    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-43a905-serving-cert\""
Sep 08 16:43:51.724233 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.724209    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"]
Sep 08 16:43:51.787476 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.787439    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-metrics-certs\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.787652 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.787490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4754bc45-cd73-46f1-b0ff-041ea793a98b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.787652 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.787568    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9px8l\" (UniqueName: \"kubernetes.io/projected/4754bc45-cd73-46f1-b0ff-041ea793a98b-kube-api-access-9px8l\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.787652 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.787625    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-maas-api-tls\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.888642 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.888608    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9px8l\" (UniqueName: \"kubernetes.io/projected/4754bc45-cd73-46f1-b0ff-041ea793a98b-kube-api-access-9px8l\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.888642 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.888640    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-maas-api-tls\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.888954 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.888690    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-metrics-certs\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.888954 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.888719    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4754bc45-cd73-46f1-b0ff-041ea793a98b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.889455 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.889428    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4754bc45-cd73-46f1-b0ff-041ea793a98b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.891385 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.891367    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-metrics-certs\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.891615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.891588    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-maas-api-tls\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:51.897619 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:51.897594    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9px8l\" (UniqueName: \"kubernetes.io/projected/4754bc45-cd73-46f1-b0ff-041ea793a98b-kube-api-access-9px8l\") pod \"maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:52.028161 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:52.028135    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:52.308431 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:52.308403    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"]
Sep 08 16:43:52.309185 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:43:52.309161    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4754bc45_cd73_46f1_b0ff_041ea793a98b.slice/crio-e8c37d2f45228bef469b76bededd9ed98fc78a3958b55d9e9517e314bf487739 WatchSource:0}: Error finding container e8c37d2f45228bef469b76bededd9ed98fc78a3958b55d9e9517e314bf487739: Status 404 returned error can't find the container with id e8c37d2f45228bef469b76bededd9ed98fc78a3958b55d9e9517e314bf487739
Sep 08 16:43:52.940892 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:52.940860    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn" event={"ID":"4754bc45-cd73-46f1-b0ff-041ea793a98b","Type":"ContainerStarted","Data":"57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d"}
Sep 08 16:43:52.941273 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:52.940914    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn" event={"ID":"4754bc45-cd73-46f1-b0ff-041ea793a98b","Type":"ContainerStarted","Data":"e8c37d2f45228bef469b76bededd9ed98fc78a3958b55d9e9517e314bf487739"}
Sep 08 16:43:52.941273 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:52.940935    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:43:52.966421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:52.966374    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn" podStartSLOduration=1.528757516 podStartE2EDuration="1.966356321s" totalImagesPullingTime="437.598805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:52.963137344 +0000 UTC m=+828.666980344" watchObservedRunningTime="2026-09-08 16:43:52.966356321 +0000 UTC m=+828.670199319"
Sep 08 16:43:58.951908 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:43:58.951870    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:44:12.314880 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.314848    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"]
Sep 08 16:44:12.315351 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.315065    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" podUID="eeeeef05-2e71-47c2-8f32-d26751579fa6" containerName="maas-api" containerID="cri-o://579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9" gracePeriod=30
Sep 08 16:44:12.590204 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.590176    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:44:12.677511 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.677478    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxpwh\" (UniqueName: \"kubernetes.io/projected/eeeeef05-2e71-47c2-8f32-d26751579fa6-kube-api-access-rxpwh\") pod \"eeeeef05-2e71-47c2-8f32-d26751579fa6\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") "
Sep 08 16:44:12.677679 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.677530    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-metrics-certs\") pod \"eeeeef05-2e71-47c2-8f32-d26751579fa6\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") "
Sep 08 16:44:12.677679 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.677566    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls\") pod \"eeeeef05-2e71-47c2-8f32-d26751579fa6\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") "
Sep 08 16:44:12.677679 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.677643    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeef05-2e71-47c2-8f32-d26751579fa6-openshift-service-ca\") pod \"eeeeef05-2e71-47c2-8f32-d26751579fa6\" (UID: \"eeeeef05-2e71-47c2-8f32-d26751579fa6\") "
Sep 08 16:44:12.678110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.678083    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeeeef05-2e71-47c2-8f32-d26751579fa6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eeeeef05-2e71-47c2-8f32-d26751579fa6" (UID: "eeeeef05-2e71-47c2-8f32-d26751579fa6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:44:12.680035 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.680000    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "eeeeef05-2e71-47c2-8f32-d26751579fa6" (UID: "eeeeef05-2e71-47c2-8f32-d26751579fa6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:44:12.680035 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.680009    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeeeef05-2e71-47c2-8f32-d26751579fa6-kube-api-access-rxpwh" (OuterVolumeSpecName: "kube-api-access-rxpwh") pod "eeeeef05-2e71-47c2-8f32-d26751579fa6" (UID: "eeeeef05-2e71-47c2-8f32-d26751579fa6"). InnerVolumeSpecName "kube-api-access-rxpwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:12.680158 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.680012    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eeeeef05-2e71-47c2-8f32-d26751579fa6" (UID: "eeeeef05-2e71-47c2-8f32-d26751579fa6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:44:12.778856 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.778822    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eeeeef05-2e71-47c2-8f32-d26751579fa6-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:12.778856 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.778852    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxpwh\" (UniqueName: \"kubernetes.io/projected/eeeeef05-2e71-47c2-8f32-d26751579fa6-kube-api-access-rxpwh\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:12.779054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.778866    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:12.779054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:12.778877    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eeeeef05-2e71-47c2-8f32-d26751579fa6-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:13.066876 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.066819    2547 generic.go:356] "Generic (PLEG): container finished" podID="eeeeef05-2e71-47c2-8f32-d26751579fa6" containerID="579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9" exitCode=0
Sep 08 16:44:13.067078 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.066877    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" event={"ID":"eeeeef05-2e71-47c2-8f32-d26751579fa6","Type":"ContainerDied","Data":"579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9"}
Sep 08 16:44:13.067078 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.066894    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"
Sep 08 16:44:13.067078 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.066961    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967" event={"ID":"eeeeef05-2e71-47c2-8f32-d26751579fa6","Type":"ContainerDied","Data":"8ef9145a03a6e1a94c3d3ac07b31a15f257e36f2e2a4a3337884fb022ab6514c"}
Sep 08 16:44:13.067078 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.066984    2547 scope.go:117] "RemoveContainer" containerID="579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9"
Sep 08 16:44:13.076541 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.076523    2547 scope.go:117] "RemoveContainer" containerID="579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9"
Sep 08 16:44:13.076864 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:44:13.076842    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9\": container with ID starting with 579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9 not found: ID does not exist" containerID="579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9"
Sep 08 16:44:13.076944 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.076871    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9"} err="failed to get container status \"579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9\": rpc error: code = NotFound desc = could not find container \"579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9\": container with ID starting with 579fa2c3c29b23d36f8669bb918485067be7ea28184182c44c79a6e6d5724ca9 not found: ID does not exist"
Sep 08 16:44:13.086082 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.086060    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"]
Sep 08 16:44:13.095860 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:13.095803    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4c81c932-55fb5846c4-jx967"]
Sep 08 16:44:14.834576 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:14.834541    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeeeef05-2e71-47c2-8f32-d26751579fa6" path="/var/lib/kubelet/pods/eeeeef05-2e71-47c2-8f32-d26751579fa6/volumes"
Sep 08 16:44:16.555090 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.555060    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"]
Sep 08 16:44:16.555492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.555475    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeeeef05-2e71-47c2-8f32-d26751579fa6" containerName="maas-api"
Sep 08 16:44:16.555492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.555489    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeeeef05-2e71-47c2-8f32-d26751579fa6" containerName="maas-api"
Sep 08 16:44:16.555627 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.555563    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeeeef05-2e71-47c2-8f32-d26751579fa6" containerName="maas-api"
Sep 08 16:44:16.560387 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.560367    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.562441 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.562420    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-fc1daf8b-serving-cert\""
Sep 08 16:44:16.567840 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.567690    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"]
Sep 08 16:44:16.609846 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.609812    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-openshift-service-ca\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.610017 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.609855    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdcvb\" (UniqueName: \"kubernetes.io/projected/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-kube-api-access-xdcvb\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.610017 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.609929    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.610098 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.610013    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-metrics-certs\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.710907 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.710868    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-metrics-certs\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.711102 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.710960    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-openshift-service-ca\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.711102 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.710984    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdcvb\" (UniqueName: \"kubernetes.io/projected/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-kube-api-access-xdcvb\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.711102 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.711048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.711277 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:44:16.711159    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-serving-cert: secret "maas-api-e2e-migrate-fc1daf8b-serving-cert" not found
Sep 08 16:44:16.711277 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:44:16.711241    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls podName:3f5f4817-7b7d-481f-9e71-f00eec3a61cf nodeName:}" failed. No retries permitted until 2026-09-08 16:44:17.211219383 +0000 UTC m=+852.915062376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls") pod "maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" (UID: "3f5f4817-7b7d-481f-9e71-f00eec3a61cf") : secret "maas-api-e2e-migrate-fc1daf8b-serving-cert" not found
Sep 08 16:44:16.711660 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.711641    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-openshift-service-ca\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.713469 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.713446    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-metrics-certs\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:16.723264 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:16.723242    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdcvb\" (UniqueName: \"kubernetes.io/projected/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-kube-api-access-xdcvb\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:17.216179 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:17.216148    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:17.218494 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:17.218477    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls\") pod \"maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:17.474054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:17.473968    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:17.751391 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:17.751364    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"]
Sep 08 16:44:17.757075 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:44:17.757042    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5f4817_7b7d_481f_9e71_f00eec3a61cf.slice/crio-82511a848dc4ad1b19b4e03c7c90278e7e51142352948aa5fec97fd74577b1b3 WatchSource:0}: Error finding container 82511a848dc4ad1b19b4e03c7c90278e7e51142352948aa5fec97fd74577b1b3: Status 404 returned error can't find the container with id 82511a848dc4ad1b19b4e03c7c90278e7e51142352948aa5fec97fd74577b1b3
Sep 08 16:44:18.096122 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:18.096082    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" event={"ID":"3f5f4817-7b7d-481f-9e71-f00eec3a61cf","Type":"ContainerStarted","Data":"82511a848dc4ad1b19b4e03c7c90278e7e51142352948aa5fec97fd74577b1b3"}
Sep 08 16:44:19.102673 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:19.102638    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" event={"ID":"3f5f4817-7b7d-481f-9e71-f00eec3a61cf","Type":"ContainerStarted","Data":"580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723"}
Sep 08 16:44:19.103146 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:19.102836    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:19.124596 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:19.124545    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" podStartSLOduration=2.249702303 podStartE2EDuration="3.124529349s" totalImagesPullingTime="874.827046ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:19.124295222 +0000 UTC m=+854.828138222" watchObservedRunningTime="2026-09-08 16:44:19.124529349 +0000 UTC m=+854.828372348"
Sep 08 16:44:25.113343 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:25.113307    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:47.949522 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:47.949485    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"]
Sep 08 16:44:47.950039 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:47.949687    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" podUID="3f5f4817-7b7d-481f-9e71-f00eec3a61cf" containerName="maas-api" containerID="cri-o://580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723" gracePeriod=30
Sep 08 16:44:48.206920 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.206857    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:48.267557 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.267522    2547 generic.go:356] "Generic (PLEG): container finished" podID="3f5f4817-7b7d-481f-9e71-f00eec3a61cf" containerID="580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723" exitCode=0
Sep 08 16:44:48.267745 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.267575    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" event={"ID":"3f5f4817-7b7d-481f-9e71-f00eec3a61cf","Type":"ContainerDied","Data":"580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723"}
Sep 08 16:44:48.267745 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.267583    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"
Sep 08 16:44:48.267745 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.267638    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh" event={"ID":"3f5f4817-7b7d-481f-9e71-f00eec3a61cf","Type":"ContainerDied","Data":"82511a848dc4ad1b19b4e03c7c90278e7e51142352948aa5fec97fd74577b1b3"}
Sep 08 16:44:48.267745 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.267659    2547 scope.go:117] "RemoveContainer" containerID="580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723"
Sep 08 16:44:48.279280 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.279260    2547 scope.go:117] "RemoveContainer" containerID="580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723"
Sep 08 16:44:48.279586 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:44:48.279568    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723\": container with ID starting with 580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723 not found: ID does not exist" containerID="580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723"
Sep 08 16:44:48.279652 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.279599    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723"} err="failed to get container status \"580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723\": rpc error: code = NotFound desc = could not find container \"580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723\": container with ID starting with 580e3c62f24168dfe1bc77b6f328200d8f5ad0900afd3465c880033870537723 not found: ID does not exist"
Sep 08 16:44:48.299055 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.299031    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-metrics-certs\") pod \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") "
Sep 08 16:44:48.299176 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.299092    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls\") pod \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") "
Sep 08 16:44:48.299247 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.299176    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdcvb\" (UniqueName: \"kubernetes.io/projected/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-kube-api-access-xdcvb\") pod \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") "
Sep 08 16:44:48.299247 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.299219    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-openshift-service-ca\") pod \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\" (UID: \"3f5f4817-7b7d-481f-9e71-f00eec3a61cf\") "
Sep 08 16:44:48.299628 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.299598    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f5f4817-7b7d-481f-9e71-f00eec3a61cf" (UID: "3f5f4817-7b7d-481f-9e71-f00eec3a61cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:44:48.301232 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.301209    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f5f4817-7b7d-481f-9e71-f00eec3a61cf" (UID: "3f5f4817-7b7d-481f-9e71-f00eec3a61cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:44:48.301322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.301224    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3f5f4817-7b7d-481f-9e71-f00eec3a61cf" (UID: "3f5f4817-7b7d-481f-9e71-f00eec3a61cf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:44:48.301322 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.301248    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-kube-api-access-xdcvb" (OuterVolumeSpecName: "kube-api-access-xdcvb") pod "3f5f4817-7b7d-481f-9e71-f00eec3a61cf" (UID: "3f5f4817-7b7d-481f-9e71-f00eec3a61cf"). InnerVolumeSpecName "kube-api-access-xdcvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:48.400471 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.400432    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:48.400471 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.400472    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:48.400651 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.400486    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:48.400651 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.400500    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdcvb\" (UniqueName: \"kubernetes.io/projected/3f5f4817-7b7d-481f-9e71-f00eec3a61cf-kube-api-access-xdcvb\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:44:48.589176 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.589150    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"]
Sep 08 16:44:48.594019 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.593996    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-fc1daf8b-d5754bdd9-f6zfh"]
Sep 08 16:44:48.832413 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:48.832326    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f5f4817-7b7d-481f-9e71-f00eec3a61cf" path="/var/lib/kubelet/pods/3f5f4817-7b7d-481f-9e71-f00eec3a61cf/volumes"
Sep 08 16:44:52.497448 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.497418    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"]
Sep 08 16:44:52.497834 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.497807    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f5f4817-7b7d-481f-9e71-f00eec3a61cf" containerName="maas-api"
Sep 08 16:44:52.497834 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.497820    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f5f4817-7b7d-481f-9e71-f00eec3a61cf" containerName="maas-api"
Sep 08 16:44:52.497923 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.497895    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f5f4817-7b7d-481f-9e71-f00eec3a61cf" containerName="maas-api"
Sep 08 16:44:52.502357 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.502332    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.504876 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.504846    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-30506528-serving-cert\""
Sep 08 16:44:52.512617 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.512594    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"]
Sep 08 16:44:52.535402 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.535361    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-maas-api-tls\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.535402 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.535395    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-openshift-service-ca\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.535619 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.535539    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpkpf\" (UniqueName: \"kubernetes.io/projected/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-kube-api-access-tpkpf\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.535836 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.535612    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-metrics-certs\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.636256 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.636224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpkpf\" (UniqueName: \"kubernetes.io/projected/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-kube-api-access-tpkpf\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.636256 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.636268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-metrics-certs\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.636462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.636293    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-maas-api-tls\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.636462 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.636310    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-openshift-service-ca\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.637009 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.636918    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-openshift-service-ca\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.638838 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.638808    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-metrics-certs\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.638956 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.638859    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-maas-api-tls\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.648310 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.648292    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpkpf\" (UniqueName: \"kubernetes.io/projected/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-kube-api-access-tpkpf\") pod \"maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:52.839589 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:52.839553    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:53.120158 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.120127    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"]
Sep 08 16:44:53.121396 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:44:53.121364    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f9e9a8_b5ee_43e7_a106_4a050ca11ac8.slice/crio-55a86b4b296799a3c04e1247ede119e1e9f12a27d3048004f5d9dead8f0394f1 WatchSource:0}: Error finding container 55a86b4b296799a3c04e1247ede119e1e9f12a27d3048004f5d9dead8f0394f1: Status 404 returned error can't find the container with id 55a86b4b296799a3c04e1247ede119e1e9f12a27d3048004f5d9dead8f0394f1
Sep 08 16:44:53.235376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.235343    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"]
Sep 08 16:44:53.239634 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.239608    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.242336 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.242319    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-30506528\""
Sep 08 16:44:53.242450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.242429    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-30506528-dockercfg-tl8tr\""
Sep 08 16:44:53.251545 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.251523    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"]
Sep 08 16:44:53.303703 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.303658    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd" event={"ID":"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8","Type":"ContainerStarted","Data":"55a86b4b296799a3c04e1247ede119e1e9f12a27d3048004f5d9dead8f0394f1"}
Sep 08 16:44:53.343370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.343335    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxc4\" (UniqueName: \"kubernetes.io/projected/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-kube-api-access-cbxc4\") pod \"payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.343543 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.343394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.444762 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.444664    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.444963 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.444771    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxc4\" (UniqueName: \"kubernetes.io/projected/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-kube-api-access-cbxc4\") pod \"payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.445441 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.445415    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.454280 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.454261    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxc4\" (UniqueName: \"kubernetes.io/projected/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-kube-api-access-cbxc4\") pod \"payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.551870 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.551840    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:53.842307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:53.842284    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"]
Sep 08 16:44:53.843357 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:44:53.843326    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0d1c1a_3c2e_4f2f_89bc_f8d2ee2d432d.slice/crio-844a38316a3c677ccb60f0b1efa485641704ce8d0da44920ab15f85b2958250a WatchSource:0}: Error finding container 844a38316a3c677ccb60f0b1efa485641704ce8d0da44920ab15f85b2958250a: Status 404 returned error can't find the container with id 844a38316a3c677ccb60f0b1efa485641704ce8d0da44920ab15f85b2958250a
Sep 08 16:44:54.314582 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.314544    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf" event={"ID":"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d","Type":"ContainerStarted","Data":"44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef"}
Sep 08 16:44:54.314856 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.314603    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf" event={"ID":"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d","Type":"ContainerStarted","Data":"844a38316a3c677ccb60f0b1efa485641704ce8d0da44920ab15f85b2958250a"}
Sep 08 16:44:54.314856 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.314732    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:44:54.316208 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.316186    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd" event={"ID":"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8","Type":"ContainerStarted","Data":"9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638"}
Sep 08 16:44:54.316305 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.316239    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:44:54.335062 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.335015    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf" podStartSLOduration=1.334997454 podStartE2EDuration="1.334997454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:54.33257713 +0000 UTC m=+890.036420130" watchObservedRunningTime="2026-09-08 16:44:54.334997454 +0000 UTC m=+890.038840451"
Sep 08 16:44:54.350291 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:44:54.350232    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd" podStartSLOduration=1.9613871349999998 podStartE2EDuration="2.350215407s" totalImagesPullingTime="388.828272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:54.34904535 +0000 UTC m=+890.052888349" watchObservedRunningTime="2026-09-08 16:44:54.350215407 +0000 UTC m=+890.054058406"
Sep 08 16:45:00.146494 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.146414    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"]
Sep 08 16:45:00.150069 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.150042    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"
Sep 08 16:45:00.152230 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.152209    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-886jf\""
Sep 08 16:45:00.161481 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.161453    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"]
Sep 08 16:45:00.161608 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.161520    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"
Sep 08 16:45:00.327181 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.327141    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:45:00.433959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:00.433935    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"]
Sep 08 16:45:00.435412 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:45:00.435385    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d7e72e6_e82c_4871_bbba_ef01870aeaa8.slice/crio-9eb508f235c245f185176b0ca1e7125d60f450891beb5934088f92e39a7ea1d1 WatchSource:0}: Error finding container 9eb508f235c245f185176b0ca1e7125d60f450891beb5934088f92e39a7ea1d1: Status 404 returned error can't find the container with id 9eb508f235c245f185176b0ca1e7125d60f450891beb5934088f92e39a7ea1d1
Sep 08 16:45:01.356748 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:01.356716    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm" event={"ID":"6d7e72e6-e82c-4871-bbba-ef01870aeaa8","Type":"ContainerStarted","Data":"9eb508f235c245f185176b0ca1e7125d60f450891beb5934088f92e39a7ea1d1"}
Sep 08 16:45:04.376416 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:04.376383    2547 generic.go:356] "Generic (PLEG): container finished" podID="6d7e72e6-e82c-4871-bbba-ef01870aeaa8" containerID="79c06a733bc525d96528bf3b2ae054a995e52b428eec39d5b7d03b35d9018d91" exitCode=0
Sep 08 16:45:04.376764 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:04.376466    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm" event={"ID":"6d7e72e6-e82c-4871-bbba-ef01870aeaa8","Type":"ContainerDied","Data":"79c06a733bc525d96528bf3b2ae054a995e52b428eec39d5b7d03b35d9018d91"}
Sep 08 16:45:05.323643 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:05.323610    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:45:05.519438 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:05.519413    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"
Sep 08 16:45:05.659022 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:05.658994    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:45:05.659726 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:05.659700    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:45:06.389683 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:06.389656    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"
Sep 08 16:45:06.389683 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:06.389655    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm" event={"ID":"6d7e72e6-e82c-4871-bbba-ef01870aeaa8","Type":"ContainerDied","Data":"9eb508f235c245f185176b0ca1e7125d60f450891beb5934088f92e39a7ea1d1"}
Sep 08 16:45:06.389917 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:06.389710    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9eb508f235c245f185176b0ca1e7125d60f450891beb5934088f92e39a7ea1d1"
Sep 08 16:45:23.579822 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.579761    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"]
Sep 08 16:45:23.580401 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.580075    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd" podUID="74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" containerName="maas-api" containerID="cri-o://9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638" gracePeriod=30
Sep 08 16:45:23.616956 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.616926    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"]
Sep 08 16:45:23.620554 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.620533    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-30506528-29814765-lbvbm"]
Sep 08 16:45:23.660265 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.660236    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"]
Sep 08 16:45:23.660434 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.660414    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf" podUID="af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" containerName="payload-pre-processing" containerID="cri-o://44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef" gracePeriod=30
Sep 08 16:45:23.909565 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.909540    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:45:23.937975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.937949    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-maas-api-tls\") pod \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") "
Sep 08 16:45:23.938126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.937984    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpkpf\" (UniqueName: \"kubernetes.io/projected/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-kube-api-access-tpkpf\") pod \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") "
Sep 08 16:45:23.938126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.938059    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:45:23.938126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.938086    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-metrics-certs\") pod \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") "
Sep 08 16:45:23.938293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.938141    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-openshift-service-ca\") pod \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\" (UID: \"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8\") "
Sep 08 16:45:23.938679 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.938655    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" (UID: "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:45:23.940494 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.940469    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" (UID: "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:45:23.940763 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.940739    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-kube-api-access-tpkpf" (OuterVolumeSpecName: "kube-api-access-tpkpf") pod "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" (UID: "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8"). InnerVolumeSpecName "kube-api-access-tpkpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:23.940869 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:23.940811    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" (UID: "74f9e9a8-b5ee-43e7-a106-4a050ca11ac8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:45:24.039450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039416    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbxc4\" (UniqueName: \"kubernetes.io/projected/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-kube-api-access-cbxc4\") pod \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") "
Sep 08 16:45:24.039450 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039454    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-plugins-config-volume\") pod \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\" (UID: \"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d\") "
Sep 08 16:45:24.039662 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039650    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:24.039706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039664    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:24.039706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039673    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:24.039706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039682    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpkpf\" (UniqueName: \"kubernetes.io/projected/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8-kube-api-access-tpkpf\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:24.039868 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.039850    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" (UID: "af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:45:24.041626 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.041607    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-kube-api-access-cbxc4" (OuterVolumeSpecName: "kube-api-access-cbxc4") pod "af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" (UID: "af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d"). InnerVolumeSpecName "kube-api-access-cbxc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:24.140416 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.140329    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbxc4\" (UniqueName: \"kubernetes.io/projected/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-kube-api-access-cbxc4\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:24.140416 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.140358    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d-plugins-config-volume\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:24.492993 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.492896    2547 generic.go:356] "Generic (PLEG): container finished" podID="74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" containerID="9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638" exitCode=0
Sep 08 16:45:24.492993 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.492943    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"
Sep 08 16:45:24.493218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.492991    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd" event={"ID":"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8","Type":"ContainerDied","Data":"9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638"}
Sep 08 16:45:24.493218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.493047    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd" event={"ID":"74f9e9a8-b5ee-43e7-a106-4a050ca11ac8","Type":"ContainerDied","Data":"55a86b4b296799a3c04e1247ede119e1e9f12a27d3048004f5d9dead8f0394f1"}
Sep 08 16:45:24.493218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.493071    2547 scope.go:117] "RemoveContainer" containerID="9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638"
Sep 08 16:45:24.494468 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.494447    2547 generic.go:356] "Generic (PLEG): container finished" podID="af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" containerID="44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef" exitCode=0
Sep 08 16:45:24.494574 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.494474    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf" event={"ID":"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d","Type":"ContainerDied","Data":"44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef"}
Sep 08 16:45:24.494574 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.494496    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"
Sep 08 16:45:24.494574 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.494521    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf" event={"ID":"af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d","Type":"ContainerDied","Data":"844a38316a3c677ccb60f0b1efa485641704ce8d0da44920ab15f85b2958250a"}
Sep 08 16:45:24.503204 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.503186    2547 scope.go:117] "RemoveContainer" containerID="9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638"
Sep 08 16:45:24.503495 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:24.503473    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638\": container with ID starting with 9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638 not found: ID does not exist" containerID="9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638"
Sep 08 16:45:24.503576 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.503505    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638"} err="failed to get container status \"9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638\": rpc error: code = NotFound desc = could not find container \"9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638\": container with ID starting with 9cac8d7987b8e5d69cf6e72a8bac5f2fa52dcaf08975ec72a11631249f717638 not found: ID does not exist"
Sep 08 16:45:24.503576 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.503523    2547 scope.go:117] "RemoveContainer" containerID="44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef"
Sep 08 16:45:24.511905 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.511859    2547 scope.go:117] "RemoveContainer" containerID="44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef"
Sep 08 16:45:24.512149 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:24.512118    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef\": container with ID starting with 44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef not found: ID does not exist" containerID="44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef"
Sep 08 16:45:24.512195 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.512155    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef"} err="failed to get container status \"44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef\": rpc error: code = NotFound desc = could not find container \"44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef\": container with ID starting with 44e2ca95845ef5da40cf44e21a97736d705e3e00e65db2d7d7dfdbcb1ba915ef not found: ID does not exist"
Sep 08 16:45:24.520189 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.520170    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"]
Sep 08 16:45:24.525406 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.525386    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-30506528-5bbbffd9f6-kbhsd"]
Sep 08 16:45:24.536226 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.536204    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"]
Sep 08 16:45:24.540212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.540191    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-30506528-54fb95f6b-h5nnf"]
Sep 08 16:45:24.838108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.838079    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d7e72e6-e82c-4871-bbba-ef01870aeaa8" path="/var/lib/kubelet/pods/6d7e72e6-e82c-4871-bbba-ef01870aeaa8/volumes"
Sep 08 16:45:24.838464 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.838409    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" path="/var/lib/kubelet/pods/74f9e9a8-b5ee-43e7-a106-4a050ca11ac8/volumes"
Sep 08 16:45:24.838695 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:24.838683    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" path="/var/lib/kubelet/pods/af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d/volumes"
Sep 08 16:45:29.439852 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.439812    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"]
Sep 08 16:45:29.440438 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.440033    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z" podUID="69457727-f4bc-4400-a785-cd664bed1b74" containerName="maas-api" containerID="cri-o://cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f" gracePeriod=30
Sep 08 16:45:29.696147 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.696091    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:45:29.794140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.794104    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-maas-api-tls\") pod \"69457727-f4bc-4400-a785-cd664bed1b74\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") "
Sep 08 16:45:29.794140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.794144    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69457727-f4bc-4400-a785-cd664bed1b74-openshift-service-ca\") pod \"69457727-f4bc-4400-a785-cd664bed1b74\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") "
Sep 08 16:45:29.794377 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.794181    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-metrics-certs\") pod \"69457727-f4bc-4400-a785-cd664bed1b74\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") "
Sep 08 16:45:29.794377 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.794226    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6grt2\" (UniqueName: \"kubernetes.io/projected/69457727-f4bc-4400-a785-cd664bed1b74-kube-api-access-6grt2\") pod \"69457727-f4bc-4400-a785-cd664bed1b74\" (UID: \"69457727-f4bc-4400-a785-cd664bed1b74\") "
Sep 08 16:45:29.794525 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.794497    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69457727-f4bc-4400-a785-cd664bed1b74-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69457727-f4bc-4400-a785-cd664bed1b74" (UID: "69457727-f4bc-4400-a785-cd664bed1b74"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:45:29.796514 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.796489    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "69457727-f4bc-4400-a785-cd664bed1b74" (UID: "69457727-f4bc-4400-a785-cd664bed1b74"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:45:29.796638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.796541    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69457727-f4bc-4400-a785-cd664bed1b74" (UID: "69457727-f4bc-4400-a785-cd664bed1b74"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:45:29.796638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.796541    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69457727-f4bc-4400-a785-cd664bed1b74-kube-api-access-6grt2" (OuterVolumeSpecName: "kube-api-access-6grt2") pod "69457727-f4bc-4400-a785-cd664bed1b74" (UID: "69457727-f4bc-4400-a785-cd664bed1b74"). InnerVolumeSpecName "kube-api-access-6grt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:29.894866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.894833    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6grt2\" (UniqueName: \"kubernetes.io/projected/69457727-f4bc-4400-a785-cd664bed1b74-kube-api-access-6grt2\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:29.894866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.894861    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:29.894866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.894870    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69457727-f4bc-4400-a785-cd664bed1b74-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:29.895102 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:29.894878    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/69457727-f4bc-4400-a785-cd664bed1b74-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.085580 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.085537    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"]
Sep 08 16:45:30.085982 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.085964    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69457727-f4bc-4400-a785-cd664bed1b74" containerName="maas-api"
Sep 08 16:45:30.085982 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.085984    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="69457727-f4bc-4400-a785-cd664bed1b74" containerName="maas-api"
Sep 08 16:45:30.086144 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086010    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" containerName="payload-pre-processing"
Sep 08 16:45:30.086144 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086019    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" containerName="payload-pre-processing"
Sep 08 16:45:30.086144 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086043    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" containerName="maas-api"
Sep 08 16:45:30.086144 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086051    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" containerName="maas-api"
Sep 08 16:45:30.086144 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086060    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d7e72e6-e82c-4871-bbba-ef01870aeaa8" containerName="cleanup"
Sep 08 16:45:30.086144 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086068    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d7e72e6-e82c-4871-bbba-ef01870aeaa8" containerName="cleanup"
Sep 08 16:45:30.086440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086170    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="74f9e9a8-b5ee-43e7-a106-4a050ca11ac8" containerName="maas-api"
Sep 08 16:45:30.086440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086185    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0d1c1a-3c2e-4f2f-89bc-f8d2ee2d432d" containerName="payload-pre-processing"
Sep 08 16:45:30.086440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086195    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="69457727-f4bc-4400-a785-cd664bed1b74" containerName="maas-api"
Sep 08 16:45:30.086440 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.086207    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d7e72e6-e82c-4871-bbba-ef01870aeaa8" containerName="cleanup"
Sep 08 16:45:30.089555 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.089536    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.092537 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.092518    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-773b1848-serving-cert\""
Sep 08 16:45:30.101505 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.101484    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"]
Sep 08 16:45:30.197308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.197273    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.197506 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.197326    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-metrics-certs\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.197506 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.197413    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj62h\" (UniqueName: \"kubernetes.io/projected/04f5accf-cebb-4392-90ad-3d13e3a9da61-kube-api-access-zj62h\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.197506 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.197490    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f5accf-cebb-4392-90ad-3d13e3a9da61-openshift-service-ca\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.298469 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.298433    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f5accf-cebb-4392-90ad-3d13e3a9da61-openshift-service-ca\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.298665 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.298476    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.298665 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.298511    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-metrics-certs\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.298665 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:30.298602    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-serving-cert: secret "maas-api-e2e-derive-773b1848-serving-cert" not found
Sep 08 16:45:30.298665 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.298613    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj62h\" (UniqueName: \"kubernetes.io/projected/04f5accf-cebb-4392-90ad-3d13e3a9da61-kube-api-access-zj62h\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.298939 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:30.298691    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls podName:04f5accf-cebb-4392-90ad-3d13e3a9da61 nodeName:}" failed. No retries permitted until 2026-09-08 16:45:30.798671279 +0000 UTC m=+926.502514258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls") pod "maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" (UID: "04f5accf-cebb-4392-90ad-3d13e3a9da61") : secret "maas-api-e2e-derive-773b1848-serving-cert" not found
Sep 08 16:45:30.299199 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.299170    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f5accf-cebb-4392-90ad-3d13e3a9da61-openshift-service-ca\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.301099 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.301080    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-metrics-certs\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.309097 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.309075    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj62h\" (UniqueName: \"kubernetes.io/projected/04f5accf-cebb-4392-90ad-3d13e3a9da61-kube-api-access-zj62h\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.541437 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.541401    2547 generic.go:356] "Generic (PLEG): container finished" podID="69457727-f4bc-4400-a785-cd664bed1b74" containerID="cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f" exitCode=0
Sep 08 16:45:30.541839 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.541453    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"
Sep 08 16:45:30.541839 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.541479    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z" event={"ID":"69457727-f4bc-4400-a785-cd664bed1b74","Type":"ContainerDied","Data":"cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f"}
Sep 08 16:45:30.541839 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.541546    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z" event={"ID":"69457727-f4bc-4400-a785-cd664bed1b74","Type":"ContainerDied","Data":"ed3508bf2d21ff96311ef968ab0c8cc59d4545c7b99d64ea42a8b9b1710713c7"}
Sep 08 16:45:30.541839 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.541566    2547 scope.go:117] "RemoveContainer" containerID="cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f"
Sep 08 16:45:30.551579 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.551556    2547 scope.go:117] "RemoveContainer" containerID="cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f"
Sep 08 16:45:30.552039 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:30.552016    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f\": container with ID starting with cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f not found: ID does not exist" containerID="cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f"
Sep 08 16:45:30.552131 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.552068    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f"} err="failed to get container status \"cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f\": rpc error: code = NotFound desc = could not find container \"cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f\": container with ID starting with cddcfb64823a4ff18bd5fd5e196e28d6405627a34073645aacc1f316cbb6b10f not found: ID does not exist"
Sep 08 16:45:30.564200 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.564178    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"]
Sep 08 16:45:30.569244 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.569223    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-4cea93-79f8f49f-57p7z"]
Sep 08 16:45:30.803153 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.803072    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.805605 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.805581    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls\") pod \"maas-api-e2e-derive-773b1848-5d8dcc7584-mz484\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:30.832573 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.832544    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69457727-f4bc-4400-a785-cd664bed1b74" path="/var/lib/kubelet/pods/69457727-f4bc-4400-a785-cd664bed1b74/volumes"
Sep 08 16:45:30.976845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.976816    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"]
Sep 08 16:45:30.981460 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.981441    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:30.983853 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.983828    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-773b1848-dockercfg-l44n9\""
Sep 08 16:45:30.983992 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.983870    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-773b1848\""
Sep 08 16:45:30.987843 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:30.987812    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"]
Sep 08 16:45:31.000524 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.000497    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:31.105443 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.105407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chf7c\" (UniqueName: \"kubernetes.io/projected/6878ec04-b296-49e5-8475-d0b00eaa71e8-kube-api-access-chf7c\") pod \"payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") " pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.105625 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.105476    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6878ec04-b296-49e5-8475-d0b00eaa71e8-plugins-config-volume\") pod \"payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") " pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.206895 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.206851    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6878ec04-b296-49e5-8475-d0b00eaa71e8-plugins-config-volume\") pod \"payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") " pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.207091 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.206939    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chf7c\" (UniqueName: \"kubernetes.io/projected/6878ec04-b296-49e5-8475-d0b00eaa71e8-kube-api-access-chf7c\") pod \"payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") " pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.207817 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.207766    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6878ec04-b296-49e5-8475-d0b00eaa71e8-plugins-config-volume\") pod \"payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") " pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.216198 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.216171    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chf7c\" (UniqueName: \"kubernetes.io/projected/6878ec04-b296-49e5-8475-d0b00eaa71e8-kube-api-access-chf7c\") pod \"payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") " pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.290929 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:45:31.290901    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f5accf_cebb_4392_90ad_3d13e3a9da61.slice/crio-3d9b3cd949a7e7535a73fcaff7b01c4ac89f51215331945bde1ee079b3a6902f WatchSource:0}: Error finding container 3d9b3cd949a7e7535a73fcaff7b01c4ac89f51215331945bde1ee079b3a6902f: Status 404 returned error can't find the container with id 3d9b3cd949a7e7535a73fcaff7b01c4ac89f51215331945bde1ee079b3a6902f
Sep 08 16:45:31.292184 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.292160    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"]
Sep 08 16:45:31.294882 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.294862    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:31.550044 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.550000    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" event={"ID":"04f5accf-cebb-4392-90ad-3d13e3a9da61","Type":"ContainerStarted","Data":"3d9b3cd949a7e7535a73fcaff7b01c4ac89f51215331945bde1ee079b3a6902f"}
Sep 08 16:45:31.569264 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:31.569240    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"]
Sep 08 16:45:31.571182 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:45:31.571153    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6878ec04_b296_49e5_8475_d0b00eaa71e8.slice/crio-ad00d3a3856f07af3fbbf97f1799b64a7762df83628379bc78c701e27dbad176 WatchSource:0}: Error finding container ad00d3a3856f07af3fbbf97f1799b64a7762df83628379bc78c701e27dbad176: Status 404 returned error can't find the container with id ad00d3a3856f07af3fbbf97f1799b64a7762df83628379bc78c701e27dbad176
Sep 08 16:45:32.557459 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.557422    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" event={"ID":"04f5accf-cebb-4392-90ad-3d13e3a9da61","Type":"ContainerStarted","Data":"0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365"}
Sep 08 16:45:32.557866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.557556    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:32.559048 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.559024    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6" event={"ID":"6878ec04-b296-49e5-8475-d0b00eaa71e8","Type":"ContainerStarted","Data":"7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0"}
Sep 08 16:45:32.559175 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.559071    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6" event={"ID":"6878ec04-b296-49e5-8475-d0b00eaa71e8","Type":"ContainerStarted","Data":"ad00d3a3856f07af3fbbf97f1799b64a7762df83628379bc78c701e27dbad176"}
Sep 08 16:45:32.559175 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.559104    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:32.577121 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.577075    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" podStartSLOduration=1.849982998 podStartE2EDuration="2.577060984s" totalImagesPullingTime="727.077986ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:32.575483146 +0000 UTC m=+928.279326147" watchObservedRunningTime="2026-09-08 16:45:32.577060984 +0000 UTC m=+928.280903983"
Sep 08 16:45:32.593619 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:32.593574    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6" podStartSLOduration=2.593557364 podStartE2EDuration="2.593557364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:32.593370789 +0000 UTC m=+928.297213787" watchObservedRunningTime="2026-09-08 16:45:32.593557364 +0000 UTC m=+928.297400362"
Sep 08 16:45:38.570387 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:38.570358    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:45:42.720527 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.720487    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"]
Sep 08 16:45:42.724315 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.724292    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.726991 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.726972    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-fae677-serving-cert\""
Sep 08 16:45:42.740065 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.740042    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"]
Sep 08 16:45:42.810481 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.810447    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86c4ac37-2718-42a5-b97e-65633ebef586-openshift-service-ca\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.810481 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.810485    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crfxs\" (UniqueName: \"kubernetes.io/projected/86c4ac37-2718-42a5-b97e-65633ebef586-kube-api-access-crfxs\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.810702 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.810509    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.810702 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.810614    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-metrics-certs\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.911472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.911438    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-metrics-certs\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.911666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.911546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86c4ac37-2718-42a5-b97e-65633ebef586-openshift-service-ca\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.911666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.911569    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crfxs\" (UniqueName: \"kubernetes.io/projected/86c4ac37-2718-42a5-b97e-65633ebef586-kube-api-access-crfxs\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.911666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.911606    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.911885 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:42.911704    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-serving-cert: secret "maas-api-e2e-explicit-fae677-serving-cert" not found
Sep 08 16:45:42.911885 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:45:42.911803    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls podName:86c4ac37-2718-42a5-b97e-65633ebef586 nodeName:}" failed. No retries permitted until 2026-09-08 16:45:43.411764966 +0000 UTC m=+939.115607960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls") pod "maas-api-e2e-explicit-fae677-579dc57865-qdz5p" (UID: "86c4ac37-2718-42a5-b97e-65633ebef586") : secret "maas-api-e2e-explicit-fae677-serving-cert" not found
Sep 08 16:45:42.912299 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.912275    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86c4ac37-2718-42a5-b97e-65633ebef586-openshift-service-ca\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.914131 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.914105    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-metrics-certs\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:42.922072 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:42.922053    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crfxs\" (UniqueName: \"kubernetes.io/projected/86c4ac37-2718-42a5-b97e-65633ebef586-kube-api-access-crfxs\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:43.417557 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:43.417526    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:43.420010 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:43.419982    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls\") pod \"maas-api-e2e-explicit-fae677-579dc57865-qdz5p\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:43.566221 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:43.566192    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:45:43.635646 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:43.635616    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:43.913749 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:43.913725    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"]
Sep 08 16:45:43.915174 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:45:43.915149    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c4ac37_2718_42a5_b97e_65633ebef586.slice/crio-0c602fb54702e3fadd987144ded9227995eb752de2931d7502d43c33fe442f39 WatchSource:0}: Error finding container 0c602fb54702e3fadd987144ded9227995eb752de2931d7502d43c33fe442f39: Status 404 returned error can't find the container with id 0c602fb54702e3fadd987144ded9227995eb752de2931d7502d43c33fe442f39
Sep 08 16:45:44.628609 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:44.628571    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p" event={"ID":"86c4ac37-2718-42a5-b97e-65633ebef586","Type":"ContainerStarted","Data":"8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740"}
Sep 08 16:45:44.628844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:44.628624    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p" event={"ID":"86c4ac37-2718-42a5-b97e-65633ebef586","Type":"ContainerStarted","Data":"0c602fb54702e3fadd987144ded9227995eb752de2931d7502d43c33fe442f39"}
Sep 08 16:45:44.628844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:44.628684    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:45:44.647321 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:44.647269    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p" podStartSLOduration=2.207754625 podStartE2EDuration="2.647248294s" totalImagesPullingTime="439.493669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:44.645599715 +0000 UTC m=+940.349442714" watchObservedRunningTime="2026-09-08 16:45:44.647248294 +0000 UTC m=+940.351091309"
Sep 08 16:45:50.640436 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:45:50.640407    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:46:00.613812 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:00.613762    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"]
Sep 08 16:46:00.614611 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:00.614574    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" podUID="04f5accf-cebb-4392-90ad-3d13e3a9da61" containerName="maas-api" containerID="cri-o://0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365" gracePeriod=30
Sep 08 16:46:00.683380 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:00.683350    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"]
Sep 08 16:46:00.683802 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:00.683574    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6" podUID="6878ec04-b296-49e5-8475-d0b00eaa71e8" containerName="payload-processing" containerID="cri-o://7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0" gracePeriod=30
Sep 08 16:46:00.948297 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:00.948273    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:46:00.951361 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:00.951341    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:46:01.075076 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075049    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls\") pod \"04f5accf-cebb-4392-90ad-3d13e3a9da61\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") "
Sep 08 16:46:01.075281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075086    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj62h\" (UniqueName: \"kubernetes.io/projected/04f5accf-cebb-4392-90ad-3d13e3a9da61-kube-api-access-zj62h\") pod \"04f5accf-cebb-4392-90ad-3d13e3a9da61\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") "
Sep 08 16:46:01.075281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075111    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-metrics-certs\") pod \"04f5accf-cebb-4392-90ad-3d13e3a9da61\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") "
Sep 08 16:46:01.075281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075177    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6878ec04-b296-49e5-8475-d0b00eaa71e8-plugins-config-volume\") pod \"6878ec04-b296-49e5-8475-d0b00eaa71e8\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") "
Sep 08 16:46:01.075281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075207    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chf7c\" (UniqueName: \"kubernetes.io/projected/6878ec04-b296-49e5-8475-d0b00eaa71e8-kube-api-access-chf7c\") pod \"6878ec04-b296-49e5-8475-d0b00eaa71e8\" (UID: \"6878ec04-b296-49e5-8475-d0b00eaa71e8\") "
Sep 08 16:46:01.075281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075258    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f5accf-cebb-4392-90ad-3d13e3a9da61-openshift-service-ca\") pod \"04f5accf-cebb-4392-90ad-3d13e3a9da61\" (UID: \"04f5accf-cebb-4392-90ad-3d13e3a9da61\") "
Sep 08 16:46:01.075672 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075637    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6878ec04-b296-49e5-8475-d0b00eaa71e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6878ec04-b296-49e5-8475-d0b00eaa71e8" (UID: "6878ec04-b296-49e5-8475-d0b00eaa71e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:01.075884 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.075701    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04f5accf-cebb-4392-90ad-3d13e3a9da61-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04f5accf-cebb-4392-90ad-3d13e3a9da61" (UID: "04f5accf-cebb-4392-90ad-3d13e3a9da61"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:01.077436 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.077413    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04f5accf-cebb-4392-90ad-3d13e3a9da61" (UID: "04f5accf-cebb-4392-90ad-3d13e3a9da61"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:46:01.077436 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.077423    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "04f5accf-cebb-4392-90ad-3d13e3a9da61" (UID: "04f5accf-cebb-4392-90ad-3d13e3a9da61"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:46:01.077907 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.077886    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6878ec04-b296-49e5-8475-d0b00eaa71e8-kube-api-access-chf7c" (OuterVolumeSpecName: "kube-api-access-chf7c") pod "6878ec04-b296-49e5-8475-d0b00eaa71e8" (UID: "6878ec04-b296-49e5-8475-d0b00eaa71e8"). InnerVolumeSpecName "kube-api-access-chf7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:01.077974 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.077900    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f5accf-cebb-4392-90ad-3d13e3a9da61-kube-api-access-zj62h" (OuterVolumeSpecName: "kube-api-access-zj62h") pod "04f5accf-cebb-4392-90ad-3d13e3a9da61" (UID: "04f5accf-cebb-4392-90ad-3d13e3a9da61"). InnerVolumeSpecName "kube-api-access-zj62h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:01.175989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.175907    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f5accf-cebb-4392-90ad-3d13e3a9da61-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:46:01.175989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.175934    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:46:01.175989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.175942    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj62h\" (UniqueName: \"kubernetes.io/projected/04f5accf-cebb-4392-90ad-3d13e3a9da61-kube-api-access-zj62h\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:46:01.175989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.175951    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04f5accf-cebb-4392-90ad-3d13e3a9da61-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:46:01.175989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.175961    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6878ec04-b296-49e5-8475-d0b00eaa71e8-plugins-config-volume\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:46:01.175989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.175970    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chf7c\" (UniqueName: \"kubernetes.io/projected/6878ec04-b296-49e5-8475-d0b00eaa71e8-kube-api-access-chf7c\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:46:01.735188 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.735152    2547 generic.go:356] "Generic (PLEG): container finished" podID="04f5accf-cebb-4392-90ad-3d13e3a9da61" containerID="0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365" exitCode=0
Sep 08 16:46:01.735638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.735209    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"
Sep 08 16:46:01.735638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.735234    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" event={"ID":"04f5accf-cebb-4392-90ad-3d13e3a9da61","Type":"ContainerDied","Data":"0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365"}
Sep 08 16:46:01.735638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.735306    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484" event={"ID":"04f5accf-cebb-4392-90ad-3d13e3a9da61","Type":"ContainerDied","Data":"3d9b3cd949a7e7535a73fcaff7b01c4ac89f51215331945bde1ee079b3a6902f"}
Sep 08 16:46:01.735638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.735327    2547 scope.go:117] "RemoveContainer" containerID="0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365"
Sep 08 16:46:01.736912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.736882    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"
Sep 08 16:46:01.737003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.736914    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6" event={"ID":"6878ec04-b296-49e5-8475-d0b00eaa71e8","Type":"ContainerDied","Data":"7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0"}
Sep 08 16:46:01.737003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.736884    2547 generic.go:356] "Generic (PLEG): container finished" podID="6878ec04-b296-49e5-8475-d0b00eaa71e8" containerID="7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0" exitCode=0
Sep 08 16:46:01.737083 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.737015    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6" event={"ID":"6878ec04-b296-49e5-8475-d0b00eaa71e8","Type":"ContainerDied","Data":"ad00d3a3856f07af3fbbf97f1799b64a7762df83628379bc78c701e27dbad176"}
Sep 08 16:46:01.745866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.745849    2547 scope.go:117] "RemoveContainer" containerID="0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365"
Sep 08 16:46:01.746233 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:46:01.746208    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365\": container with ID starting with 0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365 not found: ID does not exist" containerID="0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365"
Sep 08 16:46:01.746333 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.746239    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365"} err="failed to get container status \"0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365\": rpc error: code = NotFound desc = could not find container \"0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365\": container with ID starting with 0d180754abb41b8d7ab798ea4c09adffc4ab21ea6be494da843f220b8e1e5365 not found: ID does not exist"
Sep 08 16:46:01.746333 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.746256    2547 scope.go:117] "RemoveContainer" containerID="7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0"
Sep 08 16:46:01.756671 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.756647    2547 scope.go:117] "RemoveContainer" containerID="7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0"
Sep 08 16:46:01.757018 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:46:01.756990    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0\": container with ID starting with 7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0 not found: ID does not exist" containerID="7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0"
Sep 08 16:46:01.757128 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.757023    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0"} err="failed to get container status \"7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0\": rpc error: code = NotFound desc = could not find container \"7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0\": container with ID starting with 7a1dfd38287ee6f4dd4a6214080feed9e96ad0b571eeb1fa62bc01d8923d44b0 not found: ID does not exist"
Sep 08 16:46:01.770405 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.770376    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"]
Sep 08 16:46:01.773410 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.773387    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-773b1848-64d8bfc769-sxnd6"]
Sep 08 16:46:01.789414 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.789383    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"]
Sep 08 16:46:01.793222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:01.793201    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-773b1848-5d8dcc7584-mz484"]
Sep 08 16:46:02.832837 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:02.832770    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f5accf-cebb-4392-90ad-3d13e3a9da61" path="/var/lib/kubelet/pods/04f5accf-cebb-4392-90ad-3d13e3a9da61/volumes"
Sep 08 16:46:02.833317 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:46:02.833299    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6878ec04-b296-49e5-8475-d0b00eaa71e8" path="/var/lib/kubelet/pods/6878ec04-b296-49e5-8475-d0b00eaa71e8/volumes"
Sep 08 16:47:13.319193 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.319162    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"]
Sep 08 16:47:13.319633 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.319373    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p" podUID="86c4ac37-2718-42a5-b97e-65633ebef586" containerName="maas-api" containerID="cri-o://8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740" gracePeriod=30
Sep 08 16:47:13.584152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.584088    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:47:13.630872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.630839    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-metrics-certs\") pod \"86c4ac37-2718-42a5-b97e-65633ebef586\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") "
Sep 08 16:47:13.630872 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.630882    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86c4ac37-2718-42a5-b97e-65633ebef586-openshift-service-ca\") pod \"86c4ac37-2718-42a5-b97e-65633ebef586\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") "
Sep 08 16:47:13.631104 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.630912    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crfxs\" (UniqueName: \"kubernetes.io/projected/86c4ac37-2718-42a5-b97e-65633ebef586-kube-api-access-crfxs\") pod \"86c4ac37-2718-42a5-b97e-65633ebef586\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") "
Sep 08 16:47:13.631104 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.630951    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls\") pod \"86c4ac37-2718-42a5-b97e-65633ebef586\" (UID: \"86c4ac37-2718-42a5-b97e-65633ebef586\") "
Sep 08 16:47:13.631265 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.631233    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86c4ac37-2718-42a5-b97e-65633ebef586-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86c4ac37-2718-42a5-b97e-65633ebef586" (UID: "86c4ac37-2718-42a5-b97e-65633ebef586"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:47:13.633221 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.633187    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c4ac37-2718-42a5-b97e-65633ebef586-kube-api-access-crfxs" (OuterVolumeSpecName: "kube-api-access-crfxs") pod "86c4ac37-2718-42a5-b97e-65633ebef586" (UID: "86c4ac37-2718-42a5-b97e-65633ebef586"). InnerVolumeSpecName "kube-api-access-crfxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:13.633331 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.633214    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "86c4ac37-2718-42a5-b97e-65633ebef586" (UID: "86c4ac37-2718-42a5-b97e-65633ebef586"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:47:13.633331 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.633226    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86c4ac37-2718-42a5-b97e-65633ebef586" (UID: "86c4ac37-2718-42a5-b97e-65633ebef586"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:47:13.732362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.732320    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:47:13.732362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.732361    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86c4ac37-2718-42a5-b97e-65633ebef586-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:47:13.732362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.732371    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crfxs\" (UniqueName: \"kubernetes.io/projected/86c4ac37-2718-42a5-b97e-65633ebef586-kube-api-access-crfxs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:47:13.732603 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:13.732380    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86c4ac37-2718-42a5-b97e-65633ebef586-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:47:14.133232 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.133194    2547 generic.go:356] "Generic (PLEG): container finished" podID="86c4ac37-2718-42a5-b97e-65633ebef586" containerID="8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740" exitCode=0
Sep 08 16:47:14.133435 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.133251    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"
Sep 08 16:47:14.133435 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.133290    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p" event={"ID":"86c4ac37-2718-42a5-b97e-65633ebef586","Type":"ContainerDied","Data":"8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740"}
Sep 08 16:47:14.133435 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.133347    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p" event={"ID":"86c4ac37-2718-42a5-b97e-65633ebef586","Type":"ContainerDied","Data":"0c602fb54702e3fadd987144ded9227995eb752de2931d7502d43c33fe442f39"}
Sep 08 16:47:14.133435 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.133373    2547 scope.go:117] "RemoveContainer" containerID="8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740"
Sep 08 16:47:14.143600 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.143581    2547 scope.go:117] "RemoveContainer" containerID="8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740"
Sep 08 16:47:14.143921 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:47:14.143903    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740\": container with ID starting with 8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740 not found: ID does not exist" containerID="8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740"
Sep 08 16:47:14.144002 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.143928    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740"} err="failed to get container status \"8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740\": rpc error: code = NotFound desc = could not find container \"8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740\": container with ID starting with 8851e23b18c9d4db46462d4548dd2e39b83b9b681d2940050953bfa429172740 not found: ID does not exist"
Sep 08 16:47:14.154715 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.154688    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"]
Sep 08 16:47:14.158739 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.158713    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-fae677-579dc57865-qdz5p"]
Sep 08 16:47:14.834319 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:14.834283    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86c4ac37-2718-42a5-b97e-65633ebef586" path="/var/lib/kubelet/pods/86c4ac37-2718-42a5-b97e-65633ebef586/volumes"
Sep 08 16:47:43.158409 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.158373    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"]
Sep 08 16:47:43.159004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.158932    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f5accf-cebb-4392-90ad-3d13e3a9da61" containerName="maas-api"
Sep 08 16:47:43.159004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.158952    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f5accf-cebb-4392-90ad-3d13e3a9da61" containerName="maas-api"
Sep 08 16:47:43.159004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.158965    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c4ac37-2718-42a5-b97e-65633ebef586" containerName="maas-api"
Sep 08 16:47:43.159004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.158973    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c4ac37-2718-42a5-b97e-65633ebef586" containerName="maas-api"
Sep 08 16:47:43.159004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.158997    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6878ec04-b296-49e5-8475-d0b00eaa71e8" containerName="payload-processing"
Sep 08 16:47:43.159004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.159006    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6878ec04-b296-49e5-8475-d0b00eaa71e8" containerName="payload-processing"
Sep 08 16:47:43.159319 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.159109    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f5accf-cebb-4392-90ad-3d13e3a9da61" containerName="maas-api"
Sep 08 16:47:43.159319 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.159122    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6878ec04-b296-49e5-8475-d0b00eaa71e8" containerName="payload-processing"
Sep 08 16:47:43.159319 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.159131    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c4ac37-2718-42a5-b97e-65633ebef586" containerName="maas-api"
Sep 08 16:47:43.162423 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.162401    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.164697 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.164672    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bdae4bb7-serving-cert\""
Sep 08 16:47:43.172047 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.172026    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"]
Sep 08 16:47:43.305938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.305903    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4df4\" (UniqueName: \"kubernetes.io/projected/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-kube-api-access-k4df4\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.305938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.305940    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-metrics-certs\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.306143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.306037    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-openshift-service-ca\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.306143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.306092    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.406864 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.406825    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-openshift-service-ca\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.407064 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.406904    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.407064 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.406931    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4df4\" (UniqueName: \"kubernetes.io/projected/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-kube-api-access-k4df4\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.407064 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.406960    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-metrics-certs\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.407064 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:47:43.407054    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-serving-cert: secret "maas-api-e2e-mt-bdae4bb7-serving-cert" not found
Sep 08 16:47:43.407297 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:47:43.407135    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls podName:5e0e17ad-df1b-4fe5-a813-8372bb474e8f nodeName:}" failed. No retries permitted until 2026-09-08 16:47:43.907111887 +0000 UTC m=+1059.610954865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls") pod "maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" (UID: "5e0e17ad-df1b-4fe5-a813-8372bb474e8f") : secret "maas-api-e2e-mt-bdae4bb7-serving-cert" not found
Sep 08 16:47:43.407568 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.407547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-openshift-service-ca\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.409515 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.409460    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-metrics-certs\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.415663 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.415645    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4df4\" (UniqueName: \"kubernetes.io/projected/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-kube-api-access-k4df4\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.911918 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.911881    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:43.914576 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:43.914547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls\") pod \"maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:44.074920 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:44.074882    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:44.349097 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:44.349071    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"]
Sep 08 16:47:44.350666 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:47:44.350635    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0e17ad_df1b_4fe5_a813_8372bb474e8f.slice/crio-edd1514be3eea3146882997a5d81125923b894e1ef0602af6e5a5ded23628b57 WatchSource:0}: Error finding container edd1514be3eea3146882997a5d81125923b894e1ef0602af6e5a5ded23628b57: Status 404 returned error can't find the container with id edd1514be3eea3146882997a5d81125923b894e1ef0602af6e5a5ded23628b57
Sep 08 16:47:44.352038 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:44.352021    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:47:45.303989 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:45.303942    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" event={"ID":"5e0e17ad-df1b-4fe5-a813-8372bb474e8f","Type":"ContainerStarted","Data":"1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558"}
Sep 08 16:47:45.304165 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:45.304017    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" event={"ID":"5e0e17ad-df1b-4fe5-a813-8372bb474e8f","Type":"ContainerStarted","Data":"edd1514be3eea3146882997a5d81125923b894e1ef0602af6e5a5ded23628b57"}
Sep 08 16:47:45.304165 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:45.304043    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:47:45.324392 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:45.324250    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" podStartSLOduration=1.609942369 podStartE2EDuration="2.324226748s" totalImagesPullingTime="714.284379ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:47:45.319676898 +0000 UTC m=+1061.023519879" watchObservedRunningTime="2026-09-08 16:47:45.324226748 +0000 UTC m=+1061.028069749"
Sep 08 16:47:51.316030 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:47:51.316003    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:48:25.591174 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.591138    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"]
Sep 08 16:48:25.591824 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.591407    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" podUID="5e0e17ad-df1b-4fe5-a813-8372bb474e8f" containerName="maas-api" containerID="cri-o://1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558" gracePeriod=30
Sep 08 16:48:25.837416 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.837387    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:48:25.966852 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.966748    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-metrics-certs\") pod \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") "
Sep 08 16:48:25.966852 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.966822    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls\") pod \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") "
Sep 08 16:48:25.967081 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.966856    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-openshift-service-ca\") pod \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") "
Sep 08 16:48:25.967081 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.966888    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4df4\" (UniqueName: \"kubernetes.io/projected/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-kube-api-access-k4df4\") pod \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\" (UID: \"5e0e17ad-df1b-4fe5-a813-8372bb474e8f\") "
Sep 08 16:48:25.967234 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.967200    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5e0e17ad-df1b-4fe5-a813-8372bb474e8f" (UID: "5e0e17ad-df1b-4fe5-a813-8372bb474e8f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:25.969209 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.969179    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5e0e17ad-df1b-4fe5-a813-8372bb474e8f" (UID: "5e0e17ad-df1b-4fe5-a813-8372bb474e8f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:25.969334 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.969220    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5e0e17ad-df1b-4fe5-a813-8372bb474e8f" (UID: "5e0e17ad-df1b-4fe5-a813-8372bb474e8f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:25.969334 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:25.969239    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-kube-api-access-k4df4" (OuterVolumeSpecName: "kube-api-access-k4df4") pod "5e0e17ad-df1b-4fe5-a813-8372bb474e8f" (UID: "5e0e17ad-df1b-4fe5-a813-8372bb474e8f"). InnerVolumeSpecName "kube-api-access-k4df4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:26.068180 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.068139    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:26.068180 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.068170    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:26.068180 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.068179    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:26.068180 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.068188    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4df4\" (UniqueName: \"kubernetes.io/projected/5e0e17ad-df1b-4fe5-a813-8372bb474e8f-kube-api-access-k4df4\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:26.532765 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.532732    2547 generic.go:356] "Generic (PLEG): container finished" podID="5e0e17ad-df1b-4fe5-a813-8372bb474e8f" containerID="1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558" exitCode=0
Sep 08 16:48:26.532930 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.532794    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"
Sep 08 16:48:26.532930 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.532831    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" event={"ID":"5e0e17ad-df1b-4fe5-a813-8372bb474e8f","Type":"ContainerDied","Data":"1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558"}
Sep 08 16:48:26.532930 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.532887    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c" event={"ID":"5e0e17ad-df1b-4fe5-a813-8372bb474e8f","Type":"ContainerDied","Data":"edd1514be3eea3146882997a5d81125923b894e1ef0602af6e5a5ded23628b57"}
Sep 08 16:48:26.532930 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.532910    2547 scope.go:117] "RemoveContainer" containerID="1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558"
Sep 08 16:48:26.542941 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.542919    2547 scope.go:117] "RemoveContainer" containerID="1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558"
Sep 08 16:48:26.543257 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:48:26.543240    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558\": container with ID starting with 1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558 not found: ID does not exist" containerID="1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558"
Sep 08 16:48:26.543308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.543266    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558"} err="failed to get container status \"1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558\": rpc error: code = NotFound desc = could not find container \"1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558\": container with ID starting with 1a06048fa066701b82b34379a042c1cbde9c887b812bc1fbceb8cedaabe1e558 not found: ID does not exist"
Sep 08 16:48:26.554172 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.554143    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"]
Sep 08 16:48:26.556378 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.556358    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bdae4bb7-6bbc8748f9-vnd6c"]
Sep 08 16:48:26.833260 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:26.833177    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e0e17ad-df1b-4fe5-a813-8372bb474e8f" path="/var/lib/kubelet/pods/5e0e17ad-df1b-4fe5-a813-8372bb474e8f/volumes"
Sep 08 16:48:37.327006 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.326968    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"]
Sep 08 16:48:37.327471 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.327196    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn" podUID="4754bc45-cd73-46f1-b0ff-041ea793a98b" containerName="maas-api" containerID="cri-o://57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d" gracePeriod=30
Sep 08 16:48:37.581370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.581297    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:48:37.609762 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.609725    2547 generic.go:356] "Generic (PLEG): container finished" podID="4754bc45-cd73-46f1-b0ff-041ea793a98b" containerID="57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d" exitCode=0
Sep 08 16:48:37.609965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.609774    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn" event={"ID":"4754bc45-cd73-46f1-b0ff-041ea793a98b","Type":"ContainerDied","Data":"57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d"}
Sep 08 16:48:37.609965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.609771    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"
Sep 08 16:48:37.609965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.609838    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn" event={"ID":"4754bc45-cd73-46f1-b0ff-041ea793a98b","Type":"ContainerDied","Data":"e8c37d2f45228bef469b76bededd9ed98fc78a3958b55d9e9517e314bf487739"}
Sep 08 16:48:37.609965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.609859    2547 scope.go:117] "RemoveContainer" containerID="57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d"
Sep 08 16:48:37.619367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.619344    2547 scope.go:117] "RemoveContainer" containerID="57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d"
Sep 08 16:48:37.619672 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:48:37.619653    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d\": container with ID starting with 57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d not found: ID does not exist" containerID="57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d"
Sep 08 16:48:37.619737 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.619686    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d"} err="failed to get container status \"57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d\": rpc error: code = NotFound desc = could not find container \"57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d\": container with ID starting with 57717a6fd4b975365c4d328a12b79a203d6592cbaa40838bfa2497d7c9f3e44d not found: ID does not exist"
Sep 08 16:48:37.672093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.672059    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-maas-api-tls\") pod \"4754bc45-cd73-46f1-b0ff-041ea793a98b\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") "
Sep 08 16:48:37.672280 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.672105    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4754bc45-cd73-46f1-b0ff-041ea793a98b-openshift-service-ca\") pod \"4754bc45-cd73-46f1-b0ff-041ea793a98b\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") "
Sep 08 16:48:37.672280 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.672139    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-metrics-certs\") pod \"4754bc45-cd73-46f1-b0ff-041ea793a98b\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") "
Sep 08 16:48:37.672280 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.672251    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9px8l\" (UniqueName: \"kubernetes.io/projected/4754bc45-cd73-46f1-b0ff-041ea793a98b-kube-api-access-9px8l\") pod \"4754bc45-cd73-46f1-b0ff-041ea793a98b\" (UID: \"4754bc45-cd73-46f1-b0ff-041ea793a98b\") "
Sep 08 16:48:37.672551 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.672526    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4754bc45-cd73-46f1-b0ff-041ea793a98b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4754bc45-cd73-46f1-b0ff-041ea793a98b" (UID: "4754bc45-cd73-46f1-b0ff-041ea793a98b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:37.672666 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.672649    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4754bc45-cd73-46f1-b0ff-041ea793a98b-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.674600 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.674578    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4754bc45-cd73-46f1-b0ff-041ea793a98b" (UID: "4754bc45-cd73-46f1-b0ff-041ea793a98b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:37.674906 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.674882    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4754bc45-cd73-46f1-b0ff-041ea793a98b" (UID: "4754bc45-cd73-46f1-b0ff-041ea793a98b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:37.675001 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.674968    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4754bc45-cd73-46f1-b0ff-041ea793a98b-kube-api-access-9px8l" (OuterVolumeSpecName: "kube-api-access-9px8l") pod "4754bc45-cd73-46f1-b0ff-041ea793a98b" (UID: "4754bc45-cd73-46f1-b0ff-041ea793a98b"). InnerVolumeSpecName "kube-api-access-9px8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:37.773454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.773424    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9px8l\" (UniqueName: \"kubernetes.io/projected/4754bc45-cd73-46f1-b0ff-041ea793a98b-kube-api-access-9px8l\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.773454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.773452    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.773454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.773462    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4754bc45-cd73-46f1-b0ff-041ea793a98b-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.931156 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.931124    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"]
Sep 08 16:48:37.937899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:37.937874    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-43a905-5d7d8fffc7-95zkn"]
Sep 08 16:48:38.833020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:38.832984    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4754bc45-cd73-46f1-b0ff-041ea793a98b" path="/var/lib/kubelet/pods/4754bc45-cd73-46f1-b0ff-041ea793a98b/volumes"
Sep 08 16:48:49.694367 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694332    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"]
Sep 08 16:48:49.694723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694674    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4754bc45-cd73-46f1-b0ff-041ea793a98b" containerName="maas-api"
Sep 08 16:48:49.694723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694686    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4754bc45-cd73-46f1-b0ff-041ea793a98b" containerName="maas-api"
Sep 08 16:48:49.694723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694709    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e0e17ad-df1b-4fe5-a813-8372bb474e8f" containerName="maas-api"
Sep 08 16:48:49.694723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694714    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0e17ad-df1b-4fe5-a813-8372bb474e8f" containerName="maas-api"
Sep 08 16:48:49.694883 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694805    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e0e17ad-df1b-4fe5-a813-8372bb474e8f" containerName="maas-api"
Sep 08 16:48:49.694883 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.694816    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4754bc45-cd73-46f1-b0ff-041ea793a98b" containerName="maas-api"
Sep 08 16:48:49.699276 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.699260    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.702000 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.701972    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-608268-serving-cert\""
Sep 08 16:48:49.702317 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.702294    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dzvtd\""
Sep 08 16:48:49.702895 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.702878    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 16:48:49.709026 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.709003    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"]
Sep 08 16:48:49.884547 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.884507    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1573cdd-6ed0-4968-adaa-93832c134e4c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.884727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.884561    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.884727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.884646    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.884727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.884699    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb7hz\" (UniqueName: \"kubernetes.io/projected/b1573cdd-6ed0-4968-adaa-93832c134e4c-kube-api-access-wb7hz\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.985434 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.985338    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.985434 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.985392    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.985434 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.985435    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb7hz\" (UniqueName: \"kubernetes.io/projected/b1573cdd-6ed0-4968-adaa-93832c134e4c-kube-api-access-wb7hz\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.985717 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.985499    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1573cdd-6ed0-4968-adaa-93832c134e4c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.986203 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.986182    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1573cdd-6ed0-4968-adaa-93832c134e4c-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.987961 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.987944    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:49.988154 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:49.988134    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:50.001765 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:50.001733    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb7hz\" (UniqueName: \"kubernetes.io/projected/b1573cdd-6ed0-4968-adaa-93832c134e4c-kube-api-access-wb7hz\") pod \"maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:50.013429 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:50.013402    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:50.286871 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:50.286842    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"]
Sep 08 16:48:50.288154 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:48:50.288131    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1573cdd_6ed0_4968_adaa_93832c134e4c.slice/crio-60b8f131f4188e5bdba1681daebd277f27b1abc7407b9cce8bb6f107352ae6cc WatchSource:0}: Error finding container 60b8f131f4188e5bdba1681daebd277f27b1abc7407b9cce8bb6f107352ae6cc: Status 404 returned error can't find the container with id 60b8f131f4188e5bdba1681daebd277f27b1abc7407b9cce8bb6f107352ae6cc
Sep 08 16:48:50.683579 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:50.683492    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l" event={"ID":"b1573cdd-6ed0-4968-adaa-93832c134e4c","Type":"ContainerStarted","Data":"60b8f131f4188e5bdba1681daebd277f27b1abc7407b9cce8bb6f107352ae6cc"}
Sep 08 16:48:51.691344 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:51.691310    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l" event={"ID":"b1573cdd-6ed0-4968-adaa-93832c134e4c","Type":"ContainerStarted","Data":"85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af"}
Sep 08 16:48:51.691760 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:51.691465    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:48:51.707282 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:51.707168    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l" podStartSLOduration=2.039927888 podStartE2EDuration="2.707149176s" totalImagesPullingTime="667.221288ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:48:51.706528443 +0000 UTC m=+1127.410371455" watchObservedRunningTime="2026-09-08 16:48:51.707149176 +0000 UTC m=+1127.410992182"
Sep 08 16:48:57.704433 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:48:57.704405    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:49:16.114194 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.114153    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"]
Sep 08 16:49:16.119146 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.119121    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.121513 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.121490    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 16:49:16.121640 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.121521    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-6e5401-openshift-default-dockercfg-z4p2f\""
Sep 08 16:49:16.130429 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.130401    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"]
Sep 08 16:49:16.220660 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220617    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8997f0-3c6e-4011-aba8-5e819610eecf-istiod-ca-cert\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.220914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220673    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-credential-socket\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.220914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-data\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.220914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220827    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-podinfo\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.220914 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-socket\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.221110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220937    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-envoy\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.221110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.220994    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htn5k\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-kube-api-access-htn5k\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.221110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.221044    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-token\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.221110 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.221067    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-certs\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.321854 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321819    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-podinfo\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321873    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-socket\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321895    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-envoy\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321926    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htn5k\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-kube-api-access-htn5k\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321955    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-token\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321972    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-certs\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.321999    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8997f0-3c6e-4011-aba8-5e819610eecf-istiod-ca-cert\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322060 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.322051    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-credential-socket\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.322089    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-data\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322451 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.322414    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-certs\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.322499    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-credential-socket\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.322518    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-data\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.322814 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.322758    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-socket\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.323044 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.323020    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8997f0-3c6e-4011-aba8-5e819610eecf-istiod-ca-cert\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.324457 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.324439    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-envoy\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.324607 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.324590    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-podinfo\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.330035 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.330009    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-token\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.330214 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.330195    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htn5k\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-kube-api-access-htn5k\") pod \"e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") " pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.430329 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.430241    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:16.708449 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.708423    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"]
Sep 08 16:49:16.710262 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:49:16.710231    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8997f0_3c6e_4011_aba8_5e819610eecf.slice/crio-77496a83ef264791bf6378bdeff752ac5c07180aa1325590c9e66117060f41b2 WatchSource:0}: Error finding container 77496a83ef264791bf6378bdeff752ac5c07180aa1325590c9e66117060f41b2: Status 404 returned error can't find the container with id 77496a83ef264791bf6378bdeff752ac5c07180aa1325590c9e66117060f41b2
Sep 08 16:49:16.832661 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:16.832625    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" event={"ID":"cc8997f0-3c6e-4011-aba8-5e819610eecf","Type":"ContainerStarted","Data":"77496a83ef264791bf6378bdeff752ac5c07180aa1325590c9e66117060f41b2"}
Sep 08 16:49:18.772362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.772302    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"]
Sep 08 16:49:18.777108 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.777085    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.780247 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.780068    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-6b15ca-serving-cert\""
Sep 08 16:49:18.781202 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.781178    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"]
Sep 08 16:49:18.845984 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.845955    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.846185 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.845997    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w422v\" (UniqueName: \"kubernetes.io/projected/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-kube-api-access-w422v\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.846185 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.846129    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.846185 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.846160    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.947051 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.947017    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.947051 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.947059    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.947298 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.947183    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.947298 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:49:18.947204    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-serving-cert: secret "maas-api-e2e-shared-b-w3-6b15ca-serving-cert" not found
Sep 08 16:49:18.947298 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.947254    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w422v\" (UniqueName: \"kubernetes.io/projected/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-kube-api-access-w422v\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.947298 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:49:18.947281    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls podName:ae94a3f5-05d8-473a-8ecc-2a8f5202b504 nodeName:}" failed. No retries permitted until 2026-09-08 16:49:19.447258174 +0000 UTC m=+1155.151101175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls") pod "maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" (UID: "ae94a3f5-05d8-473a-8ecc-2a8f5202b504") : secret "maas-api-e2e-shared-b-w3-6b15ca-serving-cert" not found
Sep 08 16:49:18.947821 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.947772    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.950411 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.950373    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:18.955663 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:18.955638    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w422v\" (UniqueName: \"kubernetes.io/projected/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-kube-api-access-w422v\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:19.452515 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:19.452474    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:19.455312 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:19.455286    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:19.694672 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:19.694631    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:20.047119 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.047079    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 08 16:49:20.047406 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.047153    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 08 16:49:20.047406 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.047180    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 08 16:49:20.249977 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:49:20.249946    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae94a3f5_05d8_473a_8ecc_2a8f5202b504.slice/crio-123b6bde73bed2f948f5852d53a4db60ead9a7c603d63ca0c4a1d7cc0542cd16 WatchSource:0}: Error finding container 123b6bde73bed2f948f5852d53a4db60ead9a7c603d63ca0c4a1d7cc0542cd16: Status 404 returned error can't find the container with id 123b6bde73bed2f948f5852d53a4db60ead9a7c603d63ca0c4a1d7cc0542cd16
Sep 08 16:49:20.250232 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.250205    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"]
Sep 08 16:49:20.859542 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.859509    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" event={"ID":"cc8997f0-3c6e-4011-aba8-5e819610eecf","Type":"ContainerStarted","Data":"a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"}
Sep 08 16:49:20.861219 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.861190    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" event={"ID":"ae94a3f5-05d8-473a-8ecc-2a8f5202b504","Type":"ContainerStarted","Data":"eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117"}
Sep 08 16:49:20.861293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.861232    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" event={"ID":"ae94a3f5-05d8-473a-8ecc-2a8f5202b504","Type":"ContainerStarted","Data":"123b6bde73bed2f948f5852d53a4db60ead9a7c603d63ca0c4a1d7cc0542cd16"}
Sep 08 16:49:20.861293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.861254    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:20.879704 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.879631    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podStartSLOduration=1.545272453 podStartE2EDuration="4.879615262s" totalImagesPullingTime="3.334342809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:49:20.878364376 +0000 UTC m=+1156.582207439" watchObservedRunningTime="2026-09-08 16:49:20.879615262 +0000 UTC m=+1156.583458263"
Sep 08 16:49:20.897356 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:20.897305    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" podStartSLOduration=2.49806266 podStartE2EDuration="2.897289525s" totalImagesPullingTime="399.226865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:49:20.895148267 +0000 UTC m=+1156.598991267" watchObservedRunningTime="2026-09-08 16:49:20.897289525 +0000 UTC m=+1156.601132525"
Sep 08 16:49:21.431075 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:21.431029    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:21.436258 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:21.436232    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:21.870550 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:21.870517    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:21.873994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:21.873960    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:26.876386 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:26.876314    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:49:37.912990 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:37.912931    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:49:37.913412 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:37.913016    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:49:38.967129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:38.967093    2547 generic.go:356] "Generic (PLEG): container finished" podID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerID="a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f" exitCode=0
Sep 08 16:49:38.967651 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:38.967141    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" event={"ID":"cc8997f0-3c6e-4011-aba8-5e819610eecf","Type":"ContainerDied","Data":"a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"}
Sep 08 16:49:38.967651 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:38.967628    2547 scope.go:117] "RemoveContainer" containerID="a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"
Sep 08 16:49:38.968822 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:38.968763    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 08 16:49:38.968926 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:38.968885    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 08 16:49:38.968994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:38.968931    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 08 16:49:39.975637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:39.975592    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" event={"ID":"cc8997f0-3c6e-4011-aba8-5e819610eecf","Type":"ContainerStarted","Data":"99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033"}
Sep 08 16:49:40.430877 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:40.430834    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:40.431076 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:40.431052    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 16:49:40.431140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:40.431120    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 16:49:41.431650 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:41.431609    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 16:49:41.432149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:41.431689    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 16:49:42.431136 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:42.431097    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 16:49:42.431314 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:42.431175    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 16:49:43.431311 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:43.431274    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 16:49:43.431706 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:43.431355    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 16:49:44.431131 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:44.431092    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 16:49:44.431321 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:44.431152    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 16:49:45.434094 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:45.434063    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:45.434447 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:45.434389    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:45.435122 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:45.435101    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:49:48.441356 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.441320    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:48.445003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.444982    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:48.447631 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.447355    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kkgdp\""
Sep 08 16:49:48.449395 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.449373    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:48.549034 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.548994    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdpj6\" (UniqueName: \"kubernetes.io/projected/0791cdff-72c4-4444-ac65-814026287518-kube-api-access-xdpj6\") pod \"test-curl-7849-140606713148880\" (UID: \"0791cdff-72c4-4444-ac65-814026287518\") " pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:48.649740 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.649696    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdpj6\" (UniqueName: \"kubernetes.io/projected/0791cdff-72c4-4444-ac65-814026287518-kube-api-access-xdpj6\") pod \"test-curl-7849-140606713148880\" (UID: \"0791cdff-72c4-4444-ac65-814026287518\") " pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:48.660510 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.660475    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdpj6\" (UniqueName: \"kubernetes.io/projected/0791cdff-72c4-4444-ac65-814026287518-kube-api-access-xdpj6\") pod \"test-curl-7849-140606713148880\" (UID: \"0791cdff-72c4-4444-ac65-814026287518\") " pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:48.756250 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:48.756149    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:49.028388 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:49.028360    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:49.029314 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:49:49.029288    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0791cdff_72c4_4444_ac65_814026287518.slice/crio-bd4683db09c7188629a1c2ea08dd4812ff76903b0bf165c0b2cb23c83c127467 WatchSource:0}: Error finding container bd4683db09c7188629a1c2ea08dd4812ff76903b0bf165c0b2cb23c83c127467: Status 404 returned error can't find the container with id bd4683db09c7188629a1c2ea08dd4812ff76903b0bf165c0b2cb23c83c127467
Sep 08 16:49:49.040698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:49.040669    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713148880" event={"ID":"0791cdff-72c4-4444-ac65-814026287518","Type":"ContainerStarted","Data":"bd4683db09c7188629a1c2ea08dd4812ff76903b0bf165c0b2cb23c83c127467"}
Sep 08 16:49:50.047692 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:50.047657    2547 generic.go:356] "Generic (PLEG): container finished" podID="0791cdff-72c4-4444-ac65-814026287518" containerID="f28b5ca8953bede88b45f7e1ed237f9736550b309c4a17130b84810695de828f" exitCode=0
Sep 08 16:49:50.048098 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:50.047740    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713148880" event={"ID":"0791cdff-72c4-4444-ac65-814026287518","Type":"ContainerDied","Data":"f28b5ca8953bede88b45f7e1ed237f9736550b309c4a17130b84810695de828f"}
Sep 08 16:49:51.187960 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.187933    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:51.220953 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.220927    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-140606713148880_0791cdff-72c4-4444-ac65-814026287518/test-curl-7849-140606713148880/0.log"
Sep 08 16:49:51.243550 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.243509    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:51.247845 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.247802    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:51.274132 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.274104    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdpj6\" (UniqueName: \"kubernetes.io/projected/0791cdff-72c4-4444-ac65-814026287518-kube-api-access-xdpj6\") pod \"0791cdff-72c4-4444-ac65-814026287518\" (UID: \"0791cdff-72c4-4444-ac65-814026287518\") "
Sep 08 16:49:51.276436 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.276410    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0791cdff-72c4-4444-ac65-814026287518-kube-api-access-xdpj6" (OuterVolumeSpecName: "kube-api-access-xdpj6") pod "0791cdff-72c4-4444-ac65-814026287518" (UID: "0791cdff-72c4-4444-ac65-814026287518"). InnerVolumeSpecName "kube-api-access-xdpj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:49:51.375148 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.375060    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdpj6\" (UniqueName: \"kubernetes.io/projected/0791cdff-72c4-4444-ac65-814026287518-kube-api-access-xdpj6\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:49:51.376638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.376613    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:51.377021 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.377007    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0791cdff-72c4-4444-ac65-814026287518" containerName="test-curl-7849-140606713148880"
Sep 08 16:49:51.377068 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.377022    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0791cdff-72c4-4444-ac65-814026287518" containerName="test-curl-7849-140606713148880"
Sep 08 16:49:51.377103 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.377089    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0791cdff-72c4-4444-ac65-814026287518" containerName="test-curl-7849-140606713148880"
Sep 08 16:49:51.380100 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.380084    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:51.386497 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.386466    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:51.475756 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.475718    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdkw\" (UniqueName: \"kubernetes.io/projected/859edbca-a709-450a-bf39-bee8a1a6df52-kube-api-access-xgdkw\") pod \"test-curl-7849-140606713148880\" (UID: \"859edbca-a709-450a-bf39-bee8a1a6df52\") " pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:51.576762 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.576730    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdkw\" (UniqueName: \"kubernetes.io/projected/859edbca-a709-450a-bf39-bee8a1a6df52-kube-api-access-xgdkw\") pod \"test-curl-7849-140606713148880\" (UID: \"859edbca-a709-450a-bf39-bee8a1a6df52\") " pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:51.585453 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.585418    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdkw\" (UniqueName: \"kubernetes.io/projected/859edbca-a709-450a-bf39-bee8a1a6df52-kube-api-access-xgdkw\") pod \"test-curl-7849-140606713148880\" (UID: \"859edbca-a709-450a-bf39-bee8a1a6df52\") " pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:51.691492 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.691398    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:51.968152 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:51.968128    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:51.970012 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:49:51.969988    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod859edbca_a709_450a_bf39_bee8a1a6df52.slice/crio-b2ffe2a86d08b11f07e6c7c6341218529b357ff864c51c9692da6f4a312c5496 WatchSource:0}: Error finding container b2ffe2a86d08b11f07e6c7c6341218529b357ff864c51c9692da6f4a312c5496: Status 404 returned error can't find the container with id b2ffe2a86d08b11f07e6c7c6341218529b357ff864c51c9692da6f4a312c5496
Sep 08 16:49:52.059894 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:52.059867    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:52.060087 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:52.059870    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd4683db09c7188629a1c2ea08dd4812ff76903b0bf165c0b2cb23c83c127467"
Sep 08 16:49:52.061342 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:52.061305    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713148880" event={"ID":"859edbca-a709-450a-bf39-bee8a1a6df52","Type":"ContainerStarted","Data":"b2ffe2a86d08b11f07e6c7c6341218529b357ff864c51c9692da6f4a312c5496"}
Sep 08 16:49:52.071680 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:52.071638    2547 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7849-140606713148880" oldPodUID="0791cdff-72c4-4444-ac65-814026287518" podUID="859edbca-a709-450a-bf39-bee8a1a6df52"
Sep 08 16:49:52.834226 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:52.834194    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0791cdff-72c4-4444-ac65-814026287518" path="/var/lib/kubelet/pods/0791cdff-72c4-4444-ac65-814026287518/volumes"
Sep 08 16:49:53.068612 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:53.068580    2547 generic.go:356] "Generic (PLEG): container finished" podID="859edbca-a709-450a-bf39-bee8a1a6df52" containerID="36b255cf601f4947c7eab99f251b57d4e694087331d153e197340465352cafad" exitCode=0
Sep 08 16:49:53.068851 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:53.068679    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713148880" event={"ID":"859edbca-a709-450a-bf39-bee8a1a6df52","Type":"ContainerDied","Data":"36b255cf601f4947c7eab99f251b57d4e694087331d153e197340465352cafad"}
Sep 08 16:49:54.209724 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.209700    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:54.228311 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.228287    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-140606713148880_859edbca-a709-450a-bf39-bee8a1a6df52/test-curl-7849-140606713148880/0.log"
Sep 08 16:49:54.251055 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.251016    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:54.254699 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.254675    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-140606713148880"]
Sep 08 16:49:54.302587 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.302558    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgdkw\" (UniqueName: \"kubernetes.io/projected/859edbca-a709-450a-bf39-bee8a1a6df52-kube-api-access-xgdkw\") pod \"859edbca-a709-450a-bf39-bee8a1a6df52\" (UID: \"859edbca-a709-450a-bf39-bee8a1a6df52\") "
Sep 08 16:49:54.304804 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.304759    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/859edbca-a709-450a-bf39-bee8a1a6df52-kube-api-access-xgdkw" (OuterVolumeSpecName: "kube-api-access-xgdkw") pod "859edbca-a709-450a-bf39-bee8a1a6df52" (UID: "859edbca-a709-450a-bf39-bee8a1a6df52"). InnerVolumeSpecName "kube-api-access-xgdkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:49:54.373421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.373336    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:54.373723 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.373711    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859edbca-a709-450a-bf39-bee8a1a6df52" containerName="test-curl-7849-140606713148880"
Sep 08 16:49:54.373764 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.373725    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="859edbca-a709-450a-bf39-bee8a1a6df52" containerName="test-curl-7849-140606713148880"
Sep 08 16:49:54.373813 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.373806    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="859edbca-a709-450a-bf39-bee8a1a6df52" containerName="test-curl-7849-140606713148880"
Sep 08 16:49:54.376733 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.376718    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:54.383244 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.383212    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:54.404107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.404074    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgdkw\" (UniqueName: \"kubernetes.io/projected/859edbca-a709-450a-bf39-bee8a1a6df52-kube-api-access-xgdkw\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:49:54.504561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.504520    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkmr7\" (UniqueName: \"kubernetes.io/projected/c3569404-609b-4271-92b9-a94ba72d904f-kube-api-access-xkmr7\") pod \"test-curl-7849-140606713149456\" (UID: \"c3569404-609b-4271-92b9-a94ba72d904f\") " pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:54.605337 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.605298    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkmr7\" (UniqueName: \"kubernetes.io/projected/c3569404-609b-4271-92b9-a94ba72d904f-kube-api-access-xkmr7\") pod \"test-curl-7849-140606713149456\" (UID: \"c3569404-609b-4271-92b9-a94ba72d904f\") " pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:54.614087 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.614055    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkmr7\" (UniqueName: \"kubernetes.io/projected/c3569404-609b-4271-92b9-a94ba72d904f-kube-api-access-xkmr7\") pod \"test-curl-7849-140606713149456\" (UID: \"c3569404-609b-4271-92b9-a94ba72d904f\") " pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:54.687524 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.687436    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:54.836748 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.836708    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="859edbca-a709-450a-bf39-bee8a1a6df52" path="/var/lib/kubelet/pods/859edbca-a709-450a-bf39-bee8a1a6df52/volumes"
Sep 08 16:49:54.960350 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:54.960324    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:54.962106 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:49:54.962084    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3569404_609b_4271_92b9_a94ba72d904f.slice/crio-9d7637f33aadae1c0087e8367a406cec6eb16390659ab85eacd8ec567402a78b WatchSource:0}: Error finding container 9d7637f33aadae1c0087e8367a406cec6eb16390659ab85eacd8ec567402a78b: Status 404 returned error can't find the container with id 9d7637f33aadae1c0087e8367a406cec6eb16390659ab85eacd8ec567402a78b
Sep 08 16:49:55.080836 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:55.080776    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713149456" event={"ID":"c3569404-609b-4271-92b9-a94ba72d904f","Type":"ContainerStarted","Data":"9d7637f33aadae1c0087e8367a406cec6eb16390659ab85eacd8ec567402a78b"}
Sep 08 16:49:55.082107 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:55.082084    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713148880"
Sep 08 16:49:55.082233 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:55.082090    2547 scope.go:117] "RemoveContainer" containerID="36b255cf601f4947c7eab99f251b57d4e694087331d153e197340465352cafad"
Sep 08 16:49:57.096418 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:57.096382    2547 generic.go:356] "Generic (PLEG): container finished" podID="c3569404-609b-4271-92b9-a94ba72d904f" containerID="e1e9e1c4732d0910ee7cf7754496e31cf6bd04c87c64aa453159f1c9bf201b5a" exitCode=0
Sep 08 16:49:57.096866 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:57.096433    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713149456" event={"ID":"c3569404-609b-4271-92b9-a94ba72d904f","Type":"ContainerDied","Data":"e1e9e1c4732d0910ee7cf7754496e31cf6bd04c87c64aa453159f1c9bf201b5a"}
Sep 08 16:49:58.240024 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.239993    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:58.260606 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.260568    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-140606713149456_c3569404-609b-4271-92b9-a94ba72d904f/test-curl-7849-140606713149456/0.log"
Sep 08 16:49:58.282881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.282847    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:58.289057 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.289023    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:58.338718 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.338688    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkmr7\" (UniqueName: \"kubernetes.io/projected/c3569404-609b-4271-92b9-a94ba72d904f-kube-api-access-xkmr7\") pod \"c3569404-609b-4271-92b9-a94ba72d904f\" (UID: \"c3569404-609b-4271-92b9-a94ba72d904f\") "
Sep 08 16:49:58.340950 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.340916    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3569404-609b-4271-92b9-a94ba72d904f-kube-api-access-xkmr7" (OuterVolumeSpecName: "kube-api-access-xkmr7") pod "c3569404-609b-4271-92b9-a94ba72d904f" (UID: "c3569404-609b-4271-92b9-a94ba72d904f"). InnerVolumeSpecName "kube-api-access-xkmr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:49:58.413081 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.412991    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:58.413384 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.413371    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3569404-609b-4271-92b9-a94ba72d904f" containerName="test-curl-7849-140606713149456"
Sep 08 16:49:58.413454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.413386    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3569404-609b-4271-92b9-a94ba72d904f" containerName="test-curl-7849-140606713149456"
Sep 08 16:49:58.413454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.413447    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3569404-609b-4271-92b9-a94ba72d904f" containerName="test-curl-7849-140606713149456"
Sep 08 16:49:58.416436 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.416421    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:58.420411 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.420381    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:58.440362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.440329    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkmr7\" (UniqueName: \"kubernetes.io/projected/c3569404-609b-4271-92b9-a94ba72d904f-kube-api-access-xkmr7\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:49:58.541118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.541054    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2xxz\" (UniqueName: \"kubernetes.io/projected/21ba4a4c-a477-41ad-96d5-e509167eebc4-kube-api-access-t2xxz\") pod \"test-curl-7849-140606713149456\" (UID: \"21ba4a4c-a477-41ad-96d5-e509167eebc4\") " pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:58.641653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.641615    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2xxz\" (UniqueName: \"kubernetes.io/projected/21ba4a4c-a477-41ad-96d5-e509167eebc4-kube-api-access-t2xxz\") pod \"test-curl-7849-140606713149456\" (UID: \"21ba4a4c-a477-41ad-96d5-e509167eebc4\") " pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:58.650597 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.650570    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2xxz\" (UniqueName: \"kubernetes.io/projected/21ba4a4c-a477-41ad-96d5-e509167eebc4-kube-api-access-t2xxz\") pod \"test-curl-7849-140606713149456\" (UID: \"21ba4a4c-a477-41ad-96d5-e509167eebc4\") " pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:58.727493 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.727402    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:58.834115 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.834078    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3569404-609b-4271-92b9-a94ba72d904f" path="/var/lib/kubelet/pods/c3569404-609b-4271-92b9-a94ba72d904f/volumes"
Sep 08 16:49:58.998527 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:58.998500    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:49:58.999830 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:49:58.999803    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21ba4a4c_a477_41ad_96d5_e509167eebc4.slice/crio-7cb0a22d1e57d93788ae7b448e89bd967b835e71824a83dbe77cd0f474713f86 WatchSource:0}: Error finding container 7cb0a22d1e57d93788ae7b448e89bd967b835e71824a83dbe77cd0f474713f86: Status 404 returned error can't find the container with id 7cb0a22d1e57d93788ae7b448e89bd967b835e71824a83dbe77cd0f474713f86
Sep 08 16:49:59.108300 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:59.108272    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:49:59.108464 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:59.108305    2547 scope.go:117] "RemoveContainer" containerID="e1e9e1c4732d0910ee7cf7754496e31cf6bd04c87c64aa453159f1c9bf201b5a"
Sep 08 16:49:59.109764 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:49:59.109738    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713149456" event={"ID":"21ba4a4c-a477-41ad-96d5-e509167eebc4","Type":"ContainerStarted","Data":"7cb0a22d1e57d93788ae7b448e89bd967b835e71824a83dbe77cd0f474713f86"}
Sep 08 16:50:00.116939 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:00.116903    2547 generic.go:356] "Generic (PLEG): container finished" podID="21ba4a4c-a477-41ad-96d5-e509167eebc4" containerID="0b81719f39f78a4821c8f5158f44ece12472df658fc8385b31b8d239e16803d9" exitCode=0
Sep 08 16:50:00.117355 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:00.116946    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7849-140606713149456" event={"ID":"21ba4a4c-a477-41ad-96d5-e509167eebc4","Type":"ContainerDied","Data":"0b81719f39f78a4821c8f5158f44ece12472df658fc8385b31b8d239e16803d9"}
Sep 08 16:50:01.261407 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.261384    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:50:01.281915 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.281888    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7849-140606713149456_21ba4a4c-a477-41ad-96d5-e509167eebc4/test-curl-7849-140606713149456/0.log"
Sep 08 16:50:01.306381 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.306350    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:50:01.308683 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.308659    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7849-140606713149456"]
Sep 08 16:50:01.368487 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.368447    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2xxz\" (UniqueName: \"kubernetes.io/projected/21ba4a4c-a477-41ad-96d5-e509167eebc4-kube-api-access-t2xxz\") pod \"21ba4a4c-a477-41ad-96d5-e509167eebc4\" (UID: \"21ba4a4c-a477-41ad-96d5-e509167eebc4\") "
Sep 08 16:50:01.370858 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.370810    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ba4a4c-a477-41ad-96d5-e509167eebc4-kube-api-access-t2xxz" (OuterVolumeSpecName: "kube-api-access-t2xxz") pod "21ba4a4c-a477-41ad-96d5-e509167eebc4" (UID: "21ba4a4c-a477-41ad-96d5-e509167eebc4"). InnerVolumeSpecName "kube-api-access-t2xxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:50:01.469893 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:01.469859    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2xxz\" (UniqueName: \"kubernetes.io/projected/21ba4a4c-a477-41ad-96d5-e509167eebc4-kube-api-access-t2xxz\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:50:02.130070 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:02.130039    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cb0a22d1e57d93788ae7b448e89bd967b835e71824a83dbe77cd0f474713f86"
Sep 08 16:50:02.130070 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:02.130061    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:50:02.139526 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:50:02.139494    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7849-140606713149456\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" podUID="21ba4a4c-a477-41ad-96d5-e509167eebc4" pod="opendatahub/test-curl-7849-140606713149456"
Sep 08 16:50:02.833447 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:02.833410    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21ba4a4c-a477-41ad-96d5-e509167eebc4" path="/var/lib/kubelet/pods/21ba4a4c-a477-41ad-96d5-e509167eebc4/volumes"
Sep 08 16:50:05.698900 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:05.698875    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:50:05.699836 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:05.699817    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:50:06.022805 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.022699    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"]
Sep 08 16:50:06.023143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.023126    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ba4a4c-a477-41ad-96d5-e509167eebc4" containerName="test-curl-7849-140606713149456"
Sep 08 16:50:06.023143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.023145    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ba4a4c-a477-41ad-96d5-e509167eebc4" containerName="test-curl-7849-140606713149456"
Sep 08 16:50:06.023255 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.023245    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="21ba4a4c-a477-41ad-96d5-e509167eebc4" containerName="test-curl-7849-140606713149456"
Sep 08 16:50:06.027878 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.027852    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.030337 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.030313    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e43c7719-serving-cert\""
Sep 08 16:50:06.036403 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.036372    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"]
Sep 08 16:50:06.112219 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.112181    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.112219 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.112229    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhf2l\" (UniqueName: \"kubernetes.io/projected/2b35c7af-8838-4592-9f81-d1e58a072925-kube-api-access-fhf2l\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.112472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.112299    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b35c7af-8838-4592-9f81-d1e58a072925-openshift-service-ca\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.112472 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.112343    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-metrics-certs\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.213025 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.212985    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.213225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.213038    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhf2l\" (UniqueName: \"kubernetes.io/projected/2b35c7af-8838-4592-9f81-d1e58a072925-kube-api-access-fhf2l\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.213225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.213096    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b35c7af-8838-4592-9f81-d1e58a072925-openshift-service-ca\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.213225 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.213131    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-metrics-certs\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.213225 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:50:06.213152    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-serving-cert: secret "maas-api-e2e-mt-e43c7719-serving-cert" not found
Sep 08 16:50:06.213502 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:50:06.213236    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls podName:2b35c7af-8838-4592-9f81-d1e58a072925 nodeName:}" failed. No retries permitted until 2026-09-08 16:50:06.713214614 +0000 UTC m=+1202.417057612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls") pod "maas-api-e2e-mt-e43c7719-75694b5677-2zz72" (UID: "2b35c7af-8838-4592-9f81-d1e58a072925") : secret "maas-api-e2e-mt-e43c7719-serving-cert" not found
Sep 08 16:50:06.213844 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.213823    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b35c7af-8838-4592-9f81-d1e58a072925-openshift-service-ca\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.215902 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.215879    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-metrics-certs\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.220858 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.220833    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhf2l\" (UniqueName: \"kubernetes.io/projected/2b35c7af-8838-4592-9f81-d1e58a072925-kube-api-access-fhf2l\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.718128 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.718086    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.720709 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.720686    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls\") pod \"maas-api-e2e-mt-e43c7719-75694b5677-2zz72\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:06.941965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:06.941929    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:07.219941 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:07.219914    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"]
Sep 08 16:50:07.221250 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:50:07.221223    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b35c7af_8838_4592_9f81_d1e58a072925.slice/crio-e280c9be4922985986525af6027c27496c35c2f435a3661f8ca2d9562c63fa7f WatchSource:0}: Error finding container e280c9be4922985986525af6027c27496c35c2f435a3661f8ca2d9562c63fa7f: Status 404 returned error can't find the container with id e280c9be4922985986525af6027c27496c35c2f435a3661f8ca2d9562c63fa7f
Sep 08 16:50:08.165525 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:08.165426    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72" event={"ID":"2b35c7af-8838-4592-9f81-d1e58a072925","Type":"ContainerStarted","Data":"85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6"}
Sep 08 16:50:08.165994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:08.165529    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72" event={"ID":"2b35c7af-8838-4592-9f81-d1e58a072925","Type":"ContainerStarted","Data":"e280c9be4922985986525af6027c27496c35c2f435a3661f8ca2d9562c63fa7f"}
Sep 08 16:50:08.165994 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:08.165573    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:50:08.183425 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:08.183355    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72" podStartSLOduration=1.6262648720000001 podStartE2EDuration="2.183338078s" totalImagesPullingTime="557.073206ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:50:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:50:08.181064275 +0000 UTC m=+1203.884907272" watchObservedRunningTime="2026-09-08 16:50:08.183338078 +0000 UTC m=+1203.887181077"
Sep 08 16:50:14.176586 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:50:14.176557    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:51:05.741496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:05.741406    2547 scope.go:117] "RemoveContainer" containerID="79c06a733bc525d96528bf3b2ae054a995e52b428eec39d5b7d03b35d9018d91"
Sep 08 16:51:25.135161 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.135121    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"]
Sep 08 16:51:25.135690 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.135347    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72" podUID="2b35c7af-8838-4592-9f81-d1e58a072925" containerName="maas-api" containerID="cri-o://85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6" gracePeriod=30
Sep 08 16:51:25.388795 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.388710    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:51:25.435217 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.435179    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls\") pod \"2b35c7af-8838-4592-9f81-d1e58a072925\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") "
Sep 08 16:51:25.435421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.435309    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-metrics-certs\") pod \"2b35c7af-8838-4592-9f81-d1e58a072925\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") "
Sep 08 16:51:25.435421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.435348    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhf2l\" (UniqueName: \"kubernetes.io/projected/2b35c7af-8838-4592-9f81-d1e58a072925-kube-api-access-fhf2l\") pod \"2b35c7af-8838-4592-9f81-d1e58a072925\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") "
Sep 08 16:51:25.435421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.435398    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b35c7af-8838-4592-9f81-d1e58a072925-openshift-service-ca\") pod \"2b35c7af-8838-4592-9f81-d1e58a072925\" (UID: \"2b35c7af-8838-4592-9f81-d1e58a072925\") "
Sep 08 16:51:25.435924 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.435854    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b35c7af-8838-4592-9f81-d1e58a072925-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2b35c7af-8838-4592-9f81-d1e58a072925" (UID: "2b35c7af-8838-4592-9f81-d1e58a072925"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:51:25.437563 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.437539    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2b35c7af-8838-4592-9f81-d1e58a072925" (UID: "2b35c7af-8838-4592-9f81-d1e58a072925"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:51:25.437658 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.437554    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2b35c7af-8838-4592-9f81-d1e58a072925" (UID: "2b35c7af-8838-4592-9f81-d1e58a072925"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:51:25.437658 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.437566    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b35c7af-8838-4592-9f81-d1e58a072925-kube-api-access-fhf2l" (OuterVolumeSpecName: "kube-api-access-fhf2l") pod "2b35c7af-8838-4592-9f81-d1e58a072925" (UID: "2b35c7af-8838-4592-9f81-d1e58a072925"). InnerVolumeSpecName "kube-api-access-fhf2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:51:25.536293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.536257    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b35c7af-8838-4592-9f81-d1e58a072925-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:51:25.536293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.536291    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:51:25.536501 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.536305    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2b35c7af-8838-4592-9f81-d1e58a072925-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:51:25.536501 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.536316    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhf2l\" (UniqueName: \"kubernetes.io/projected/2b35c7af-8838-4592-9f81-d1e58a072925-kube-api-access-fhf2l\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:51:25.605093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.604093    2547 generic.go:356] "Generic (PLEG): container finished" podID="2b35c7af-8838-4592-9f81-d1e58a072925" containerID="85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6" exitCode=0
Sep 08 16:51:25.605093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.604286    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72" event={"ID":"2b35c7af-8838-4592-9f81-d1e58a072925","Type":"ContainerDied","Data":"85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6"}
Sep 08 16:51:25.605093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.604368    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72" event={"ID":"2b35c7af-8838-4592-9f81-d1e58a072925","Type":"ContainerDied","Data":"e280c9be4922985986525af6027c27496c35c2f435a3661f8ca2d9562c63fa7f"}
Sep 08 16:51:25.605093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.604412    2547 scope.go:117] "RemoveContainer" containerID="85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6"
Sep 08 16:51:25.605093 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.604617    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"
Sep 08 16:51:25.621022 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.621001    2547 scope.go:117] "RemoveContainer" containerID="85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6"
Sep 08 16:51:25.621297 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:51:25.621279    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6\": container with ID starting with 85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6 not found: ID does not exist" containerID="85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6"
Sep 08 16:51:25.621345 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.621305    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6"} err="failed to get container status \"85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6\": rpc error: code = NotFound desc = could not find container \"85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6\": container with ID starting with 85b70463cbeeed82050f992e0b522dd31f90390161497e538d94688751cf16c6 not found: ID does not exist"
Sep 08 16:51:25.629253 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.629226    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"]
Sep 08 16:51:25.633910 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:25.633887    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e43c7719-75694b5677-2zz72"]
Sep 08 16:51:26.832933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:51:26.832899    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b35c7af-8838-4592-9f81-d1e58a072925" path="/var/lib/kubelet/pods/2b35c7af-8838-4592-9f81-d1e58a072925/volumes"
Sep 08 16:52:11.077054 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.077011    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7852-9ea3f6"]
Sep 08 16:52:11.077615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.077588    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b35c7af-8838-4592-9f81-d1e58a072925" containerName="maas-api"
Sep 08 16:52:11.077615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.077608    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b35c7af-8838-4592-9f81-d1e58a072925" containerName="maas-api"
Sep 08 16:52:11.077736 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.077716    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b35c7af-8838-4592-9f81-d1e58a072925" containerName="maas-api"
Sep 08 16:52:11.081864 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.081844    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:11.084612 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.084584    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kkgdp\""
Sep 08 16:52:11.087978 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.087955    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-9ea3f6"]
Sep 08 16:52:11.162411 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.162382    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprnf\" (UniqueName: \"kubernetes.io/projected/42d80d79-0f69-450d-845b-b318b21b6cf7-kube-api-access-fprnf\") pod \"mt-curl-7852-9ea3f6\" (UID: \"42d80d79-0f69-450d-845b-b318b21b6cf7\") " pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:11.263496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.263453    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprnf\" (UniqueName: \"kubernetes.io/projected/42d80d79-0f69-450d-845b-b318b21b6cf7-kube-api-access-fprnf\") pod \"mt-curl-7852-9ea3f6\" (UID: \"42d80d79-0f69-450d-845b-b318b21b6cf7\") " pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:11.273637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.273605    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprnf\" (UniqueName: \"kubernetes.io/projected/42d80d79-0f69-450d-845b-b318b21b6cf7-kube-api-access-fprnf\") pod \"mt-curl-7852-9ea3f6\" (UID: \"42d80d79-0f69-450d-845b-b318b21b6cf7\") " pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:11.393840 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.393736    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:11.668552 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.668526    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-9ea3f6"]
Sep 08 16:52:11.670467 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:52:11.670440    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42d80d79_0f69_450d_845b_b318b21b6cf7.slice/crio-6b5c3a6c61926a352f06c1fa1053a717034dfdf51dca81c6b25c52edce48b895 WatchSource:0}: Error finding container 6b5c3a6c61926a352f06c1fa1053a717034dfdf51dca81c6b25c52edce48b895: Status 404 returned error can't find the container with id 6b5c3a6c61926a352f06c1fa1053a717034dfdf51dca81c6b25c52edce48b895
Sep 08 16:52:11.871980 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:11.871946    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-9ea3f6" event={"ID":"42d80d79-0f69-450d-845b-b318b21b6cf7","Type":"ContainerStarted","Data":"6b5c3a6c61926a352f06c1fa1053a717034dfdf51dca81c6b25c52edce48b895"}
Sep 08 16:52:12.878937 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:12.878903    2547 generic.go:356] "Generic (PLEG): container finished" podID="42d80d79-0f69-450d-845b-b318b21b6cf7" containerID="1444b76f3e46c301944766c94974d5e3ac724963453110d463c25f900802dc96" exitCode=0
Sep 08 16:52:12.879310 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:12.878960    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-9ea3f6" event={"ID":"42d80d79-0f69-450d-845b-b318b21b6cf7","Type":"ContainerDied","Data":"1444b76f3e46c301944766c94974d5e3ac724963453110d463c25f900802dc96"}
Sep 08 16:52:14.015773 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.015746    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:14.049954 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.049927    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7852-9ea3f6_42d80d79-0f69-450d-845b-b318b21b6cf7/mt-curl-7852-9ea3f6/0.log"
Sep 08 16:52:14.074522 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.074487    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7852-9ea3f6"]
Sep 08 16:52:14.078159 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.078132    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7852-9ea3f6"]
Sep 08 16:52:14.086892 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.086867    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fprnf\" (UniqueName: \"kubernetes.io/projected/42d80d79-0f69-450d-845b-b318b21b6cf7-kube-api-access-fprnf\") pod \"42d80d79-0f69-450d-845b-b318b21b6cf7\" (UID: \"42d80d79-0f69-450d-845b-b318b21b6cf7\") "
Sep 08 16:52:14.089042 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.089012    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42d80d79-0f69-450d-845b-b318b21b6cf7-kube-api-access-fprnf" (OuterVolumeSpecName: "kube-api-access-fprnf") pod "42d80d79-0f69-450d-845b-b318b21b6cf7" (UID: "42d80d79-0f69-450d-845b-b318b21b6cf7"). InnerVolumeSpecName "kube-api-access-fprnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:52:14.188350 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.188265    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fprnf\" (UniqueName: \"kubernetes.io/projected/42d80d79-0f69-450d-845b-b318b21b6cf7-kube-api-access-fprnf\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:52:14.833348 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.833316    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42d80d79-0f69-450d-845b-b318b21b6cf7" path="/var/lib/kubelet/pods/42d80d79-0f69-450d-845b-b318b21b6cf7/volumes"
Sep 08 16:52:14.891323 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.891292    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-9ea3f6"
Sep 08 16:52:14.891515 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:52:14.891352    2547 scope.go:117] "RemoveContainer" containerID="1444b76f3e46c301944766c94974d5e3ac724963453110d463c25f900802dc96"
Sep 08 16:53:20.459126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.459077    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"]
Sep 08 16:53:20.459630 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.459612    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42d80d79-0f69-450d-845b-b318b21b6cf7" containerName="mt-curl-7852-9ea3f6"
Sep 08 16:53:20.459700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.459633    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="42d80d79-0f69-450d-845b-b318b21b6cf7" containerName="mt-curl-7852-9ea3f6"
Sep 08 16:53:20.459747 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.459737    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="42d80d79-0f69-450d-845b-b318b21b6cf7" containerName="mt-curl-7852-9ea3f6"
Sep 08 16:53:20.464014 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.463995    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.468961 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.468938    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-246729-serving-cert\""
Sep 08 16:53:20.475391 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.475369    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"]
Sep 08 16:53:20.589372 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.589331    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-metrics-certs\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.589372 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.589371    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c579n\" (UniqueName: \"kubernetes.io/projected/7ca19945-5442-41aa-a57f-e7886d45639c-kube-api-access-c579n\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.589602 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.589419    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.589602 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.589520    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca19945-5442-41aa-a57f-e7886d45639c-openshift-service-ca\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.690331 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.690284    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.690531 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.690373    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca19945-5442-41aa-a57f-e7886d45639c-openshift-service-ca\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.690531 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.690445    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-metrics-certs\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.690531 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:20.690463    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-246729-serving-cert: secret "maas-api-e2e-api-a-246729-serving-cert" not found
Sep 08 16:53:20.690703 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:20.690551    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls podName:7ca19945-5442-41aa-a57f-e7886d45639c nodeName:}" failed. No retries permitted until 2026-09-08 16:53:21.190529789 +0000 UTC m=+1396.894372772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls") pod "maas-api-e2e-api-a-246729-6479bb8659-tlcfk" (UID: "7ca19945-5442-41aa-a57f-e7886d45639c") : secret "maas-api-e2e-api-a-246729-serving-cert" not found
Sep 08 16:53:20.690703 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.690468    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c579n\" (UniqueName: \"kubernetes.io/projected/7ca19945-5442-41aa-a57f-e7886d45639c-kube-api-access-c579n\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.691082 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.691062    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca19945-5442-41aa-a57f-e7886d45639c-openshift-service-ca\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.693149 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.693128    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-metrics-certs\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:20.709201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:20.709125    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c579n\" (UniqueName: \"kubernetes.io/projected/7ca19945-5442-41aa-a57f-e7886d45639c-kube-api-access-c579n\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:21.196014 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.195968    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:21.198594 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.198559    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls\") pod \"maas-api-e2e-api-a-246729-6479bb8659-tlcfk\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:21.374959 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.374921    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:21.584433 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.584402    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"]
Sep 08 16:53:21.587941 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.587922    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:21.590693 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:21.590662    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"payload-processing-e2e-api-a-246729-dockercfg-nmsjp\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-246729-dockercfg-nmsjp\"" type="*v1.Secret"
Sep 08 16:53:21.590832 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:21.590745    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" podUID="1847eaa3-29a6-4404-a4e8-2c774b050d92" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:21.590891 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:21.590839    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"payload-processing-plugins-e2e-api-a-246729\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-246729\"" type="*v1.ConfigMap"
Sep 08 16:53:21.618539 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.618506    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"]
Sep 08 16:53:21.683610 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.683585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"]
Sep 08 16:53:21.684904 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:53:21.684875    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca19945_5442_41aa_a57f_e7886d45639c.slice/crio-dfc03122e331514ee37d5528e3a34e71e4c124882ba60457f8ef215372a51594 WatchSource:0}: Error finding container dfc03122e331514ee37d5528e3a34e71e4c124882ba60457f8ef215372a51594: Status 404 returned error can't find the container with id dfc03122e331514ee37d5528e3a34e71e4c124882ba60457f8ef215372a51594
Sep 08 16:53:21.686248 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.686231    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:53:21.700504 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.700476    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:21.700639 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.700561    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzmbw\" (UniqueName: \"kubernetes.io/projected/1847eaa3-29a6-4404-a4e8-2c774b050d92-kube-api-access-kzmbw\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:21.801563 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.801529    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:21.801739 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.801605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzmbw\" (UniqueName: \"kubernetes.io/projected/1847eaa3-29a6-4404-a4e8-2c774b050d92-kube-api-access-kzmbw\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:21.814135 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:21.814100    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzmbw\" (UniqueName: \"kubernetes.io/projected/1847eaa3-29a6-4404-a4e8-2c774b050d92-kube-api-access-kzmbw\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:22.264423 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:22.264385    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk" event={"ID":"7ca19945-5442-41aa-a57f-e7886d45639c","Type":"ContainerStarted","Data":"dfc03122e331514ee37d5528e3a34e71e4c124882ba60457f8ef215372a51594"}
Sep 08 16:53:22.802013 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:22.801980    2547 configmap.go:193] Couldn't get configMap openshift-ingress/payload-processing-plugins-e2e-api-a-246729: failed to sync configmap cache: timed out waiting for the condition
Sep 08 16:53:22.802373 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:22.802062    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume podName:1847eaa3-29a6-4404-a4e8-2c774b050d92 nodeName:}" failed. No retries permitted until 2026-09-08 16:53:23.302045737 +0000 UTC m=+1399.005888720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugins-config-volume" (UniqueName: "kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume") pod "payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" (UID: "1847eaa3-29a6-4404-a4e8-2c774b050d92") : failed to sync configmap cache: timed out waiting for the condition
Sep 08 16:53:22.828699 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:22.828666    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-246729\""
Sep 08 16:53:23.187376 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.187294    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-246729-dockercfg-nmsjp\""
Sep 08 16:53:23.273436 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.273398    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk" event={"ID":"7ca19945-5442-41aa-a57f-e7886d45639c","Type":"ContainerStarted","Data":"7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890"}
Sep 08 16:53:23.273646 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.273599    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:23.313449 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.313400    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk" podStartSLOduration=2.599499526 podStartE2EDuration="3.313383954s" totalImagesPullingTime="713.884428ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:53:23.31144456 +0000 UTC m=+1399.015287559" watchObservedRunningTime="2026-09-08 16:53:23.313383954 +0000 UTC m=+1399.017226955"
Sep 08 16:53:23.315558 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.315535    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:23.316236 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.316218    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:23.398548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.398511    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:23.681735 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:23.681707    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"]
Sep 08 16:53:23.683574 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:53:23.683545    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1847eaa3_29a6_4404_a4e8_2c774b050d92.slice/crio-6fe7581f53c2e805c20c6d553b03635073a657eaa5b9ba4350775f3778bed50c WatchSource:0}: Error finding container 6fe7581f53c2e805c20c6d553b03635073a657eaa5b9ba4350775f3778bed50c: Status 404 returned error can't find the container with id 6fe7581f53c2e805c20c6d553b03635073a657eaa5b9ba4350775f3778bed50c
Sep 08 16:53:24.281826 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:24.281761    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" event={"ID":"1847eaa3-29a6-4404-a4e8-2c774b050d92","Type":"ContainerStarted","Data":"29b6255fcf09df22703aed49575111322c5d21520afdaf2ed5c510c478295659"}
Sep 08 16:53:24.282287 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:24.281838    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" event={"ID":"1847eaa3-29a6-4404-a4e8-2c774b050d92","Type":"ContainerStarted","Data":"6fe7581f53c2e805c20c6d553b03635073a657eaa5b9ba4350775f3778bed50c"}
Sep 08 16:53:24.282287 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:24.282068    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:24.303726 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:24.303649    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" podStartSLOduration=3.303632302 podStartE2EDuration="3.303632302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:53:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:53:24.300855011 +0000 UTC m=+1400.004698012" watchObservedRunningTime="2026-09-08 16:53:24.303632302 +0000 UTC m=+1400.007475318"
Sep 08 16:53:25.840114 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:25.840077    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7852-a98b2c"]
Sep 08 16:53:25.843621 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:25.843604    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:25.846420 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:25.846404    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kkgdp\""
Sep 08 16:53:25.858204 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:25.858182    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-a98b2c"]
Sep 08 16:53:25.946421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:25.946380    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z77c\" (UniqueName: \"kubernetes.io/projected/4f2ac422-c463-4424-9265-a6b4a8f8c2c0-kube-api-access-8z77c\") pod \"mt-curl-7852-a98b2c\" (UID: \"4f2ac422-c463-4424-9265-a6b4a8f8c2c0\") " pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:26.047653 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:26.047618    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z77c\" (UniqueName: \"kubernetes.io/projected/4f2ac422-c463-4424-9265-a6b4a8f8c2c0-kube-api-access-8z77c\") pod \"mt-curl-7852-a98b2c\" (UID: \"4f2ac422-c463-4424-9265-a6b4a8f8c2c0\") " pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:26.056763 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:26.056732    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z77c\" (UniqueName: \"kubernetes.io/projected/4f2ac422-c463-4424-9265-a6b4a8f8c2c0-kube-api-access-8z77c\") pod \"mt-curl-7852-a98b2c\" (UID: \"4f2ac422-c463-4424-9265-a6b4a8f8c2c0\") " pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:26.152611 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:26.152526    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:26.434525 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:26.434496    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-a98b2c"]
Sep 08 16:53:26.436338 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:53:26.436317    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f2ac422_c463_4424_9265_a6b4a8f8c2c0.slice/crio-f1ff2b7803e95c0984f18cc3f59f7c4021282797d58e958ecb25c69ca630cfa3 WatchSource:0}: Error finding container f1ff2b7803e95c0984f18cc3f59f7c4021282797d58e958ecb25c69ca630cfa3: Status 404 returned error can't find the container with id f1ff2b7803e95c0984f18cc3f59f7c4021282797d58e958ecb25c69ca630cfa3
Sep 08 16:53:27.303687 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:27.303654    2547 generic.go:356] "Generic (PLEG): container finished" podID="4f2ac422-c463-4424-9265-a6b4a8f8c2c0" containerID="810fd6da81d24793ac0f7be8724e31e435ea703f2b661c5d71e6dba1c48bdfdb" exitCode=0
Sep 08 16:53:27.304080 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:27.303742    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-a98b2c" event={"ID":"4f2ac422-c463-4424-9265-a6b4a8f8c2c0","Type":"ContainerDied","Data":"810fd6da81d24793ac0f7be8724e31e435ea703f2b661c5d71e6dba1c48bdfdb"}
Sep 08 16:53:27.304080 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:27.303810    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-a98b2c" event={"ID":"4f2ac422-c463-4424-9265-a6b4a8f8c2c0","Type":"ContainerStarted","Data":"f1ff2b7803e95c0984f18cc3f59f7c4021282797d58e958ecb25c69ca630cfa3"}
Sep 08 16:53:28.455178 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.455155    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:28.484283 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.484255    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7852-a98b2c_4f2ac422-c463-4424-9265-a6b4a8f8c2c0/mt-curl-7852-a98b2c/0.log"
Sep 08 16:53:28.518908 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.518879    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7852-a98b2c"]
Sep 08 16:53:28.525315 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.525288    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7852-a98b2c"]
Sep 08 16:53:28.568484 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.568405    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z77c\" (UniqueName: \"kubernetes.io/projected/4f2ac422-c463-4424-9265-a6b4a8f8c2c0-kube-api-access-8z77c\") pod \"4f2ac422-c463-4424-9265-a6b4a8f8c2c0\" (UID: \"4f2ac422-c463-4424-9265-a6b4a8f8c2c0\") "
Sep 08 16:53:28.570696 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.570661    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2ac422-c463-4424-9265-a6b4a8f8c2c0-kube-api-access-8z77c" (OuterVolumeSpecName: "kube-api-access-8z77c") pod "4f2ac422-c463-4424-9265-a6b4a8f8c2c0" (UID: "4f2ac422-c463-4424-9265-a6b4a8f8c2c0"). InnerVolumeSpecName "kube-api-access-8z77c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:53:28.653081 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.653051    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7852-ee95df"]
Sep 08 16:53:28.653454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.653442    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2ac422-c463-4424-9265-a6b4a8f8c2c0" containerName="mt-curl-7852-a98b2c"
Sep 08 16:53:28.653494 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.653456    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2ac422-c463-4424-9265-a6b4a8f8c2c0" containerName="mt-curl-7852-a98b2c"
Sep 08 16:53:28.653534 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.653517    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2ac422-c463-4424-9265-a6b4a8f8c2c0" containerName="mt-curl-7852-a98b2c"
Sep 08 16:53:28.656390 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.656374    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:28.666020 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.665997    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-ee95df"]
Sep 08 16:53:28.669521 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.669497    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z77c\" (UniqueName: \"kubernetes.io/projected/4f2ac422-c463-4424-9265-a6b4a8f8c2c0-kube-api-access-8z77c\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:53:28.770468 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.770433    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ntf\" (UniqueName: \"kubernetes.io/projected/cd902150-2fb1-4379-bd27-34d11fe6c5a8-kube-api-access-h8ntf\") pod \"mt-curl-7852-ee95df\" (UID: \"cd902150-2fb1-4379-bd27-34d11fe6c5a8\") " pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:28.832835 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.832757    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f2ac422-c463-4424-9265-a6b4a8f8c2c0" path="/var/lib/kubelet/pods/4f2ac422-c463-4424-9265-a6b4a8f8c2c0/volumes"
Sep 08 16:53:28.871561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.871526    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ntf\" (UniqueName: \"kubernetes.io/projected/cd902150-2fb1-4379-bd27-34d11fe6c5a8-kube-api-access-h8ntf\") pod \"mt-curl-7852-ee95df\" (UID: \"cd902150-2fb1-4379-bd27-34d11fe6c5a8\") " pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:28.889308 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.889275    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ntf\" (UniqueName: \"kubernetes.io/projected/cd902150-2fb1-4379-bd27-34d11fe6c5a8-kube-api-access-h8ntf\") pod \"mt-curl-7852-ee95df\" (UID: \"cd902150-2fb1-4379-bd27-34d11fe6c5a8\") " pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:28.966126 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:28.966086    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:29.250731 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:29.250702    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7852-ee95df"]
Sep 08 16:53:29.252730 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:53:29.252704    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd902150_2fb1_4379_bd27_34d11fe6c5a8.slice/crio-91dceba7aa51fc83fd8d3c56fb6b118720f2701ce0c6cdb226f946bbf24e70a8 WatchSource:0}: Error finding container 91dceba7aa51fc83fd8d3c56fb6b118720f2701ce0c6cdb226f946bbf24e70a8: Status 404 returned error can't find the container with id 91dceba7aa51fc83fd8d3c56fb6b118720f2701ce0c6cdb226f946bbf24e70a8
Sep 08 16:53:29.287223 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:29.287196    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:53:29.316698 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:29.316675    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-a98b2c"
Sep 08 16:53:29.316881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:29.316721    2547 scope.go:117] "RemoveContainer" containerID="810fd6da81d24793ac0f7be8724e31e435ea703f2b661c5d71e6dba1c48bdfdb"
Sep 08 16:53:29.318188 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:29.318048    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-ee95df" event={"ID":"cd902150-2fb1-4379-bd27-34d11fe6c5a8","Type":"ContainerStarted","Data":"91dceba7aa51fc83fd8d3c56fb6b118720f2701ce0c6cdb226f946bbf24e70a8"}
Sep 08 16:53:30.325301 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:30.325261    2547 generic.go:356] "Generic (PLEG): container finished" podID="cd902150-2fb1-4379-bd27-34d11fe6c5a8" containerID="4fa5c6077630bf5cdef2401390e8bdf1e48ebe414d36177a55a593533c6e39ad" exitCode=0
Sep 08 16:53:30.325731 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:30.325353    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7852-ee95df" event={"ID":"cd902150-2fb1-4379-bd27-34d11fe6c5a8","Type":"ContainerDied","Data":"4fa5c6077630bf5cdef2401390e8bdf1e48ebe414d36177a55a593533c6e39ad"}
Sep 08 16:53:31.469516 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.469492    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:31.496182 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.496152    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7852-ee95df_cd902150-2fb1-4379-bd27-34d11fe6c5a8/mt-curl-7852-ee95df/0.log"
Sep 08 16:53:31.528095 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.528064    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7852-ee95df"]
Sep 08 16:53:31.533035 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.533011    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7852-ee95df"]
Sep 08 16:53:31.595863 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.595740    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8ntf\" (UniqueName: \"kubernetes.io/projected/cd902150-2fb1-4379-bd27-34d11fe6c5a8-kube-api-access-h8ntf\") pod \"cd902150-2fb1-4379-bd27-34d11fe6c5a8\" (UID: \"cd902150-2fb1-4379-bd27-34d11fe6c5a8\") "
Sep 08 16:53:31.598109 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.598076    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd902150-2fb1-4379-bd27-34d11fe6c5a8-kube-api-access-h8ntf" (OuterVolumeSpecName: "kube-api-access-h8ntf") pod "cd902150-2fb1-4379-bd27-34d11fe6c5a8" (UID: "cd902150-2fb1-4379-bd27-34d11fe6c5a8"). InnerVolumeSpecName "kube-api-access-h8ntf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:53:31.697103 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:31.697066    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8ntf\" (UniqueName: \"kubernetes.io/projected/cd902150-2fb1-4379-bd27-34d11fe6c5a8-kube-api-access-h8ntf\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:53:32.340550 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:32.340525    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91dceba7aa51fc83fd8d3c56fb6b118720f2701ce0c6cdb226f946bbf24e70a8"
Sep 08 16:53:32.340713 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:32.340556    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:32.355154 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:32.355123    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7852-ee95df\" is forbidden: User \"system:node:ip-10-0-129-146.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-129-146.ec2.internal' and this object" podUID="cd902150-2fb1-4379-bd27-34d11fe6c5a8" pod="opendatahub/mt-curl-7852-ee95df"
Sep 08 16:53:32.833561 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:32.833528    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd902150-2fb1-4379-bd27-34d11fe6c5a8" path="/var/lib/kubelet/pods/cd902150-2fb1-4379-bd27-34d11fe6c5a8/volumes"
Sep 08 16:53:35.291587 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:35.291547    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:53:54.693417 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.693385    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"]
Sep 08 16:53:54.693904 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.693835    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd902150-2fb1-4379-bd27-34d11fe6c5a8" containerName="mt-curl-7852-ee95df"
Sep 08 16:53:54.693904 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.693850    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd902150-2fb1-4379-bd27-34d11fe6c5a8" containerName="mt-curl-7852-ee95df"
Sep 08 16:53:54.693998 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.693922    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd902150-2fb1-4379-bd27-34d11fe6c5a8" containerName="mt-curl-7852-ee95df"
Sep 08 16:53:54.698255 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.698238    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.702768 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.702599    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-7818c2-serving-cert\""
Sep 08 16:53:54.713463 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.713435    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"]
Sep 08 16:53:54.814302 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.814258    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.814534 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.814319    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbed16a3-920b-436b-8e91-7dfd9030f652-openshift-service-ca\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.814534 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.814343    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-metrics-certs\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.814534 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.814411    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj99h\" (UniqueName: \"kubernetes.io/projected/bbed16a3-920b-436b-8e91-7dfd9030f652-kube-api-access-kj99h\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.915848 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.915769    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.916096 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.915873    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbed16a3-920b-436b-8e91-7dfd9030f652-openshift-service-ca\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.916096 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.915900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-metrics-certs\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.916096 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:54.915921    2547 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-serving-cert: secret "maas-api-e2e-api-b-7818c2-serving-cert" not found
Sep 08 16:53:54.916096 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.915956    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj99h\" (UniqueName: \"kubernetes.io/projected/bbed16a3-920b-436b-8e91-7dfd9030f652-kube-api-access-kj99h\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.916096 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:53:54.915983    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls podName:bbed16a3-920b-436b-8e91-7dfd9030f652 nodeName:}" failed. No retries permitted until 2026-09-08 16:53:55.415967691 +0000 UTC m=+1431.119810668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls") pod "maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" (UID: "bbed16a3-920b-436b-8e91-7dfd9030f652") : secret "maas-api-e2e-api-b-7818c2-serving-cert" not found
Sep 08 16:53:54.916640 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.916620    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbed16a3-920b-436b-8e91-7dfd9030f652-openshift-service-ca\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.918659 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.918638    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-metrics-certs\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:54.927864 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:54.927836    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj99h\" (UniqueName: \"kubernetes.io/projected/bbed16a3-920b-436b-8e91-7dfd9030f652-kube-api-access-kj99h\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:55.420196 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:55.420161    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:55.422642 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:55.422613    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls\") pod \"maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:55.609810 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:55.609735    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:55.900313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:55.900273    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"]
Sep 08 16:53:55.904587 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:53:55.904563    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbed16a3_920b_436b_8e91_7dfd9030f652.slice/crio-d43f43ada022367f81e46e978afbc5ee8f071e6f2fa33ceec558ab221ba45712 WatchSource:0}: Error finding container d43f43ada022367f81e46e978afbc5ee8f071e6f2fa33ceec558ab221ba45712: Status 404 returned error can't find the container with id d43f43ada022367f81e46e978afbc5ee8f071e6f2fa33ceec558ab221ba45712
Sep 08 16:53:56.481755 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:56.481717    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" event={"ID":"bbed16a3-920b-436b-8e91-7dfd9030f652","Type":"ContainerStarted","Data":"9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553"}
Sep 08 16:53:56.481983 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:56.481799    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" event={"ID":"bbed16a3-920b-436b-8e91-7dfd9030f652","Type":"ContainerStarted","Data":"d43f43ada022367f81e46e978afbc5ee8f071e6f2fa33ceec558ab221ba45712"}
Sep 08 16:53:56.481983 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:56.481830    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:53:56.515776 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:53:56.515721    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" podStartSLOduration=2.095232628 podStartE2EDuration="2.515703809s" totalImagesPullingTime="420.471181ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:53:56.515203061 +0000 UTC m=+1432.219046061" watchObservedRunningTime="2026-09-08 16:53:56.515703809 +0000 UTC m=+1432.219546817"
Sep 08 16:54:02.493319 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:02.493282    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:54:42.385720 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.385685    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"]
Sep 08 16:54:42.388281 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.385931    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk" podUID="7ca19945-5442-41aa-a57f-e7886d45639c" containerName="maas-api" containerID="cri-o://7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890" gracePeriod=30
Sep 08 16:54:42.506570 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.506542    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"]
Sep 08 16:54:42.506748 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.506728    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" podUID="1847eaa3-29a6-4404-a4e8-2c774b050d92" containerName="payload-pre-processing" containerID="cri-o://29b6255fcf09df22703aed49575111322c5d21520afdaf2ed5c510c478295659" gracePeriod=30
Sep 08 16:54:42.643548 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.643475    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:54:42.759679 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.759651    2547 generic.go:356] "Generic (PLEG): container finished" podID="7ca19945-5442-41aa-a57f-e7886d45639c" containerID="7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890" exitCode=0
Sep 08 16:54:42.759857 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.759699    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"
Sep 08 16:54:42.759857 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.759732    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk" event={"ID":"7ca19945-5442-41aa-a57f-e7886d45639c","Type":"ContainerDied","Data":"7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890"}
Sep 08 16:54:42.759857 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.759801    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk" event={"ID":"7ca19945-5442-41aa-a57f-e7886d45639c","Type":"ContainerDied","Data":"dfc03122e331514ee37d5528e3a34e71e4c124882ba60457f8ef215372a51594"}
Sep 08 16:54:42.759857 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.759832    2547 scope.go:117] "RemoveContainer" containerID="7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890"
Sep 08 16:54:42.760294 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.760270    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-metrics-certs\") pod \"7ca19945-5442-41aa-a57f-e7886d45639c\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") "
Sep 08 16:54:42.760370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.760342    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca19945-5442-41aa-a57f-e7886d45639c-openshift-service-ca\") pod \"7ca19945-5442-41aa-a57f-e7886d45639c\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") "
Sep 08 16:54:42.760444 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.760431    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c579n\" (UniqueName: \"kubernetes.io/projected/7ca19945-5442-41aa-a57f-e7886d45639c-kube-api-access-c579n\") pod \"7ca19945-5442-41aa-a57f-e7886d45639c\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") "
Sep 08 16:54:42.760563 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.760493    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls\") pod \"7ca19945-5442-41aa-a57f-e7886d45639c\" (UID: \"7ca19945-5442-41aa-a57f-e7886d45639c\") "
Sep 08 16:54:42.760679 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.760654    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ca19945-5442-41aa-a57f-e7886d45639c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ca19945-5442-41aa-a57f-e7886d45639c" (UID: "7ca19945-5442-41aa-a57f-e7886d45639c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:54:42.760863 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.760842    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ca19945-5442-41aa-a57f-e7886d45639c-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:54:42.762101 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.762078    2547 generic.go:356] "Generic (PLEG): container finished" podID="1847eaa3-29a6-4404-a4e8-2c774b050d92" containerID="29b6255fcf09df22703aed49575111322c5d21520afdaf2ed5c510c478295659" exitCode=0
Sep 08 16:54:42.762229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.762149    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" event={"ID":"1847eaa3-29a6-4404-a4e8-2c774b050d92","Type":"ContainerDied","Data":"29b6255fcf09df22703aed49575111322c5d21520afdaf2ed5c510c478295659"}
Sep 08 16:54:42.762946 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.762922    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7ca19945-5442-41aa-a57f-e7886d45639c" (UID: "7ca19945-5442-41aa-a57f-e7886d45639c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:54:42.763040 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.762924    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ca19945-5442-41aa-a57f-e7886d45639c-kube-api-access-c579n" (OuterVolumeSpecName: "kube-api-access-c579n") pod "7ca19945-5442-41aa-a57f-e7886d45639c" (UID: "7ca19945-5442-41aa-a57f-e7886d45639c"). InnerVolumeSpecName "kube-api-access-c579n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:54:42.763084 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.763039    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ca19945-5442-41aa-a57f-e7886d45639c" (UID: "7ca19945-5442-41aa-a57f-e7886d45639c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:54:42.773952 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.773938    2547 scope.go:117] "RemoveContainer" containerID="7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890"
Sep 08 16:54:42.774192 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:54:42.774174    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890\": container with ID starting with 7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890 not found: ID does not exist" containerID="7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890"
Sep 08 16:54:42.774265 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.774204    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890"} err="failed to get container status \"7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890\": rpc error: code = NotFound desc = could not find container \"7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890\": container with ID starting with 7494f93a02a1a8874456d935e22afcb1ca50d4a04b92425a3dc3b0b20dc67890 not found: ID does not exist"
Sep 08 16:54:42.776963 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.776947    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:54:42.861159 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.861130    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume\") pod \"1847eaa3-29a6-4404-a4e8-2c774b050d92\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") "
Sep 08 16:54:42.861318 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.861200    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzmbw\" (UniqueName: \"kubernetes.io/projected/1847eaa3-29a6-4404-a4e8-2c774b050d92-kube-api-access-kzmbw\") pod \"1847eaa3-29a6-4404-a4e8-2c774b050d92\" (UID: \"1847eaa3-29a6-4404-a4e8-2c774b050d92\") "
Sep 08 16:54:42.861380 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.861365    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c579n\" (UniqueName: \"kubernetes.io/projected/7ca19945-5442-41aa-a57f-e7886d45639c-kube-api-access-c579n\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:54:42.861426 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.861380    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:54:42.861426 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.861389    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ca19945-5442-41aa-a57f-e7886d45639c-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:54:42.861490 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.861458    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1847eaa3-29a6-4404-a4e8-2c774b050d92" (UID: "1847eaa3-29a6-4404-a4e8-2c774b050d92"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:54:42.863370 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.863348    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1847eaa3-29a6-4404-a4e8-2c774b050d92-kube-api-access-kzmbw" (OuterVolumeSpecName: "kube-api-access-kzmbw") pod "1847eaa3-29a6-4404-a4e8-2c774b050d92" (UID: "1847eaa3-29a6-4404-a4e8-2c774b050d92"). InnerVolumeSpecName "kube-api-access-kzmbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:54:42.962879 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.962754    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzmbw\" (UniqueName: \"kubernetes.io/projected/1847eaa3-29a6-4404-a4e8-2c774b050d92-kube-api-access-kzmbw\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:54:42.962879 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:42.962812    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1847eaa3-29a6-4404-a4e8-2c774b050d92-plugins-config-volume\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:54:43.078741 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.078706    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"]
Sep 08 16:54:43.083188 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.083165    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-246729-6479bb8659-tlcfk"]
Sep 08 16:54:43.768843 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.768731    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"
Sep 08 16:54:43.768843 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.768765    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8" event={"ID":"1847eaa3-29a6-4404-a4e8-2c774b050d92","Type":"ContainerDied","Data":"6fe7581f53c2e805c20c6d553b03635073a657eaa5b9ba4350775f3778bed50c"}
Sep 08 16:54:43.769355 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.768857    2547 scope.go:117] "RemoveContainer" containerID="29b6255fcf09df22703aed49575111322c5d21520afdaf2ed5c510c478295659"
Sep 08 16:54:43.804336 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.804279    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"]
Sep 08 16:54:43.806062 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:43.806037    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-246729-79c797745d-l6vb8"]
Sep 08 16:54:44.834400 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:44.834366    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1847eaa3-29a6-4404-a4e8-2c774b050d92" path="/var/lib/kubelet/pods/1847eaa3-29a6-4404-a4e8-2c774b050d92/volumes"
Sep 08 16:54:44.834764 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:54:44.834732    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ca19945-5442-41aa-a57f-e7886d45639c" path="/var/lib/kubelet/pods/7ca19945-5442-41aa-a57f-e7886d45639c/volumes"
Sep 08 16:55:05.738677 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:05.738645    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:55:05.740695 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:05.740666    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 16:55:08.084145 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.084113    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"]
Sep 08 16:55:08.084560 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.084307    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" podUID="bbed16a3-920b-436b-8e91-7dfd9030f652" containerName="maas-api" containerID="cri-o://9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553" gracePeriod=30
Sep 08 16:55:08.336882 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.336814    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:55:08.503744 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.503713    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj99h\" (UniqueName: \"kubernetes.io/projected/bbed16a3-920b-436b-8e91-7dfd9030f652-kube-api-access-kj99h\") pod \"bbed16a3-920b-436b-8e91-7dfd9030f652\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") "
Sep 08 16:55:08.503933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.503815    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbed16a3-920b-436b-8e91-7dfd9030f652-openshift-service-ca\") pod \"bbed16a3-920b-436b-8e91-7dfd9030f652\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") "
Sep 08 16:55:08.503933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.503844    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls\") pod \"bbed16a3-920b-436b-8e91-7dfd9030f652\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") "
Sep 08 16:55:08.503933 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.503886    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-metrics-certs\") pod \"bbed16a3-920b-436b-8e91-7dfd9030f652\" (UID: \"bbed16a3-920b-436b-8e91-7dfd9030f652\") "
Sep 08 16:55:08.504193 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.504169    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbed16a3-920b-436b-8e91-7dfd9030f652-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bbed16a3-920b-436b-8e91-7dfd9030f652" (UID: "bbed16a3-920b-436b-8e91-7dfd9030f652"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:55:08.506061 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.506035    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bbed16a3-920b-436b-8e91-7dfd9030f652" (UID: "bbed16a3-920b-436b-8e91-7dfd9030f652"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:55:08.506192 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.506077    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbed16a3-920b-436b-8e91-7dfd9030f652-kube-api-access-kj99h" (OuterVolumeSpecName: "kube-api-access-kj99h") pod "bbed16a3-920b-436b-8e91-7dfd9030f652" (UID: "bbed16a3-920b-436b-8e91-7dfd9030f652"). InnerVolumeSpecName "kube-api-access-kj99h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:08.506192 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.506092    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bbed16a3-920b-436b-8e91-7dfd9030f652" (UID: "bbed16a3-920b-436b-8e91-7dfd9030f652"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:55:08.605478 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.605396    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:55:08.605478 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.605425    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbed16a3-920b-436b-8e91-7dfd9030f652-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:55:08.605478 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.605433    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj99h\" (UniqueName: \"kubernetes.io/projected/bbed16a3-920b-436b-8e91-7dfd9030f652-kube-api-access-kj99h\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:55:08.605478 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.605443    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbed16a3-920b-436b-8e91-7dfd9030f652-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:55:08.912589 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.912498    2547 generic.go:356] "Generic (PLEG): container finished" podID="bbed16a3-920b-436b-8e91-7dfd9030f652" containerID="9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553" exitCode=0
Sep 08 16:55:08.912589 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.912541    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"
Sep 08 16:55:08.912589 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.912582    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" event={"ID":"bbed16a3-920b-436b-8e91-7dfd9030f652","Type":"ContainerDied","Data":"9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553"}
Sep 08 16:55:08.912875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.912627    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8" event={"ID":"bbed16a3-920b-436b-8e91-7dfd9030f652","Type":"ContainerDied","Data":"d43f43ada022367f81e46e978afbc5ee8f071e6f2fa33ceec558ab221ba45712"}
Sep 08 16:55:08.912875 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.912648    2547 scope.go:117] "RemoveContainer" containerID="9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553"
Sep 08 16:55:08.921899 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.921880    2547 scope.go:117] "RemoveContainer" containerID="9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553"
Sep 08 16:55:08.922159 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:55:08.922141    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553\": container with ID starting with 9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553 not found: ID does not exist" containerID="9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553"
Sep 08 16:55:08.922211 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.922167    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553"} err="failed to get container status \"9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553\": rpc error: code = NotFound desc = could not find container \"9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553\": container with ID starting with 9c8c2812c994f11fcb94f5bda7d2118cdd81dea6bdc80a1be488940b6d9e4553 not found: ID does not exist"
Sep 08 16:55:08.930217 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.930192    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"]
Sep 08 16:55:08.934004 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:08.933983    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-7818c2-5864747b9f-qfcv8"]
Sep 08 16:55:10.832503 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:10.832471    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbed16a3-920b-436b-8e91-7dfd9030f652" path="/var/lib/kubelet/pods/bbed16a3-920b-436b-8e91-7dfd9030f652/volumes"
Sep 08 16:55:20.301552 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301517    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"]
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301922    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbed16a3-920b-436b-8e91-7dfd9030f652" containerName="maas-api"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301939    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbed16a3-920b-436b-8e91-7dfd9030f652" containerName="maas-api"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301972    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1847eaa3-29a6-4404-a4e8-2c774b050d92" containerName="payload-pre-processing"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301981    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1847eaa3-29a6-4404-a4e8-2c774b050d92" containerName="payload-pre-processing"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301993    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ca19945-5442-41aa-a57f-e7886d45639c" containerName="maas-api"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.301999    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ca19945-5442-41aa-a57f-e7886d45639c" containerName="maas-api"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.302113    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbed16a3-920b-436b-8e91-7dfd9030f652" containerName="maas-api"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.302130    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1847eaa3-29a6-4404-a4e8-2c774b050d92" containerName="payload-pre-processing"
Sep 08 16:55:20.302205 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.302141    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ca19945-5442-41aa-a57f-e7886d45639c" containerName="maas-api"
Sep 08 16:55:20.305740 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.305723    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.308578 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.308557    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-d2b1cc-serving-cert\""
Sep 08 16:55:20.332042 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.332017    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"]
Sep 08 16:55:20.418517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.412930    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfwv2\" (UniqueName: \"kubernetes.io/projected/c739cf17-9703-4a4d-837b-8370db98a3bf-kube-api-access-tfwv2\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.418517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.413064    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c739cf17-9703-4a4d-837b-8370db98a3bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.418517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.413104    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-metrics-certs\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.418517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.413143    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.513943 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.513907    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c739cf17-9703-4a4d-837b-8370db98a3bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.513943 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.513946    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-metrics-certs\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.514146 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.513975    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.514146 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.514035    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfwv2\" (UniqueName: \"kubernetes.io/projected/c739cf17-9703-4a4d-837b-8370db98a3bf-kube-api-access-tfwv2\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.514615 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.514592    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c739cf17-9703-4a4d-837b-8370db98a3bf-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.516603 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.516582    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-maas-api-tls\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.516693 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.516642    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-metrics-certs\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.526331 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.526310    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfwv2\" (UniqueName: \"kubernetes.io/projected/c739cf17-9703-4a4d-837b-8370db98a3bf-kube-api-access-tfwv2\") pod \"maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.616438 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.616350    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:20.917435 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.917337    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"]
Sep 08 16:55:20.920530 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:55:20.920503    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc739cf17_9703_4a4d_837b_8370db98a3bf.slice/crio-c41675e6c05ed297bbc4bb54ca5f10ff071aa250f6769ebe9b9782457a29c3f0 WatchSource:0}: Error finding container c41675e6c05ed297bbc4bb54ca5f10ff071aa250f6769ebe9b9782457a29c3f0: Status 404 returned error can't find the container with id c41675e6c05ed297bbc4bb54ca5f10ff071aa250f6769ebe9b9782457a29c3f0
Sep 08 16:55:20.982960 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:20.982926    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb" event={"ID":"c739cf17-9703-4a4d-837b-8370db98a3bf","Type":"ContainerStarted","Data":"c41675e6c05ed297bbc4bb54ca5f10ff071aa250f6769ebe9b9782457a29c3f0"}
Sep 08 16:55:21.578516 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.578480    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"]
Sep 08 16:55:21.583419 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.583403    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.587218 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.587198    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d2b1cc-dockercfg-994pq\""
Sep 08 16:55:21.588621 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.588604    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d2b1cc\""
Sep 08 16:55:21.610991 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.610968    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"]
Sep 08 16:55:21.623212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.623156    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3caa66e-186a-4b05-9e4c-6406f718c8c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.623212 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.623198    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwbjq\" (UniqueName: \"kubernetes.io/projected/f3caa66e-186a-4b05-9e4c-6406f718c8c6-kube-api-access-fwbjq\") pod \"payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.724160 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.724136    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3caa66e-186a-4b05-9e4c-6406f718c8c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.724256 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.724178    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwbjq\" (UniqueName: \"kubernetes.io/projected/f3caa66e-186a-4b05-9e4c-6406f718c8c6-kube-api-access-fwbjq\") pod \"payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.724829 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.724806    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3caa66e-186a-4b05-9e4c-6406f718c8c6-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.748247 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.748222    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwbjq\" (UniqueName: \"kubernetes.io/projected/f3caa66e-186a-4b05-9e4c-6406f718c8c6-kube-api-access-fwbjq\") pod \"payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.894294 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.894217    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:21.990611 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.990575    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb" event={"ID":"c739cf17-9703-4a4d-837b-8370db98a3bf","Type":"ContainerStarted","Data":"26eec40c0e7d6d97aa8731f559a9d52e37b1fbd6dd423cb7f57fc73ec714ae40"}
Sep 08 16:55:21.990767 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:21.990683    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:22.022752 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:22.022694    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb" podStartSLOduration=1.2651064650000001 podStartE2EDuration="2.022674768s" totalImagesPullingTime="757.568303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:55:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:55:22.02144584 +0000 UTC m=+1517.725288839" watchObservedRunningTime="2026-09-08 16:55:22.022674768 +0000 UTC m=+1517.726517769"
Sep 08 16:55:22.177881 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:22.177854    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"]
Sep 08 16:55:22.179742 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:55:22.179713    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3caa66e_186a_4b05_9e4c_6406f718c8c6.slice/crio-2ad26a3d911c1abf7de719697205d5229efbfee42f41002543727d9e603467be WatchSource:0}: Error finding container 2ad26a3d911c1abf7de719697205d5229efbfee42f41002543727d9e603467be: Status 404 returned error can't find the container with id 2ad26a3d911c1abf7de719697205d5229efbfee42f41002543727d9e603467be
Sep 08 16:55:22.998003 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:22.997963    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c" event={"ID":"f3caa66e-186a-4b05-9e4c-6406f718c8c6","Type":"ContainerStarted","Data":"adccf208d1b06c42f38df3a807bf7e209502460b3021d7eab789f21608275575"}
Sep 08 16:55:22.998403 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:22.998032    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c" event={"ID":"f3caa66e-186a-4b05-9e4c-6406f718c8c6","Type":"ContainerStarted","Data":"2ad26a3d911c1abf7de719697205d5229efbfee42f41002543727d9e603467be"}
Sep 08 16:55:22.998403 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:22.998229    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:23.033748 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:23.033691    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c" podStartSLOduration=2.033673753 podStartE2EDuration="2.033673753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:55:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:55:23.03243941 +0000 UTC m=+1518.736282410" watchObservedRunningTime="2026-09-08 16:55:23.033673753 +0000 UTC m=+1518.737516754"
Sep 08 16:55:28.004062 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:28.003986    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:55:34.005842 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:34.005814    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:55:59.583944 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:59.583905    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"]
Sep 08 16:55:59.584525 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:55:59.584152    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" containerID="cri-o://99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033" gracePeriod=30
Sep 08 16:56:00.437199 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:00.437156    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:56:00.437375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:00.437243    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:56:04.829745 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.829718    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:56:04.915727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915654    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-credential-socket\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.915727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915692    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-socket\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.915727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915709    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-envoy\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915740    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8997f0-3c6e-4011-aba8-5e819610eecf-istiod-ca-cert\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915805    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-podinfo\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915950    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-certs\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916015    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htn5k\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-kube-api-access-htn5k\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.915950    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916068    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-data\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916007    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:04.916129 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916090    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-token\") pod \"cc8997f0-3c6e-4011-aba8-5e819610eecf\" (UID: \"cc8997f0-3c6e-4011-aba8-5e819610eecf\") "
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916154    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916216    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc8997f0-3c6e-4011-aba8-5e819610eecf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916291    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916407    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916423    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-data\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916435    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-credential-socket\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916449    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-workload-socket\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:04.916700 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.916462    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc8997f0-3c6e-4011-aba8-5e819610eecf-istiod-ca-cert\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:04.918243 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.918213    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:56:04.918243 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.918230    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:56:04.918243 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.918218    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-kube-api-access-htn5k" (OuterVolumeSpecName: "kube-api-access-htn5k") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "kube-api-access-htn5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:56:04.918421 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:04.918362    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc8997f0-3c6e-4011-aba8-5e819610eecf" (UID: "cc8997f0-3c6e-4011-aba8-5e819610eecf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:56:05.017683 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.017653    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-envoy\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:05.017683 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.017678    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-podinfo\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:05.017683 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.017687    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htn5k\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-kube-api-access-htn5k\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:05.017940 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.017696    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc8997f0-3c6e-4011-aba8-5e819610eecf-istio-token\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:56:05.239274 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.239186    2547 generic.go:356] "Generic (PLEG): container finished" podID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerID="99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033" exitCode=0
Sep 08 16:56:05.239274 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.239234    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"
Sep 08 16:56:05.239517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.239277    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" event={"ID":"cc8997f0-3c6e-4011-aba8-5e819610eecf","Type":"ContainerDied","Data":"99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033"}
Sep 08 16:56:05.239517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.239338    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8" event={"ID":"cc8997f0-3c6e-4011-aba8-5e819610eecf","Type":"ContainerDied","Data":"77496a83ef264791bf6378bdeff752ac5c07180aa1325590c9e66117060f41b2"}
Sep 08 16:56:05.239517 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.239369    2547 scope.go:117] "RemoveContainer" containerID="99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033"
Sep 08 16:56:05.252375 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.252352    2547 scope.go:117] "RemoveContainer" containerID="a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"
Sep 08 16:56:05.262535 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.262503    2547 scope.go:117] "RemoveContainer" containerID="99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033"
Sep 08 16:56:05.262815 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:56:05.262764    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033\": container with ID starting with 99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033 not found: ID does not exist" containerID="99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033"
Sep 08 16:56:05.262896 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.262818    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033"} err="failed to get container status \"99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033\": rpc error: code = NotFound desc = could not find container \"99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033\": container with ID starting with 99df3b2ec34769f0c11dee12fa31e6a7dcd540e726c6d8852d70f551e4813033 not found: ID does not exist"
Sep 08 16:56:05.262896 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.262843    2547 scope.go:117] "RemoveContainer" containerID="a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"
Sep 08 16:56:05.263079 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:56:05.263054    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f\": container with ID starting with a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f not found: ID does not exist" containerID="a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"
Sep 08 16:56:05.263165 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.263087    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f"} err="failed to get container status \"a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f\": rpc error: code = NotFound desc = could not find container \"a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f\": container with ID starting with a2b2d9828459e7426004d81bc8346b8d3880c8ae4e4bec80a111d5bb9f642c8f not found: ID does not exist"
Sep 08 16:56:05.277456 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.277434    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"]
Sep 08 16:56:05.285662 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.285643    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-6e5401-openshift-default-5bd59cfd78-fglp8"]
Sep 08 16:56:05.823118 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.823090    2547 scope.go:117] "RemoveContainer" containerID="f28b5ca8953bede88b45f7e1ed237f9736550b309c4a17130b84810695de828f"
Sep 08 16:56:05.832024 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:05.832006    2547 scope.go:117] "RemoveContainer" containerID="0b81719f39f78a4821c8f5158f44ece12472df658fc8385b31b8d239e16803d9"
Sep 08 16:56:06.833467 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:06.833434    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" path="/var/lib/kubelet/pods/cc8997f0-3c6e-4011-aba8-5e819610eecf/volumes"
Sep 08 16:56:54.803824 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.803773    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"]
Sep 08 16:56:54.804400 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.804207    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy"
Sep 08 16:56:54.804400 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.804218    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy"
Sep 08 16:56:54.804400 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.804287    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy"
Sep 08 16:56:54.807553 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.807530    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.809953 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.809934    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-a0a70f-serving-cert\""
Sep 08 16:56:54.822727 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.822705    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"]
Sep 08 16:56:54.870670 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.870628    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2cba67-b0c9-4e09-878c-18f93067e932-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.870874 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.870833    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.870938 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.870897    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m4x6\" (UniqueName: \"kubernetes.io/projected/3b2cba67-b0c9-4e09-878c-18f93067e932-kube-api-access-6m4x6\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.871059 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.870974    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.971951 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.971904    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.971951 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.971952    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m4x6\" (UniqueName: \"kubernetes.io/projected/3b2cba67-b0c9-4e09-878c-18f93067e932-kube-api-access-6m4x6\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.972158 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.972067    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.972158 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.972104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2cba67-b0c9-4e09-878c-18f93067e932-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.972712 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.972688    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2cba67-b0c9-4e09-878c-18f93067e932-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.974496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.974467    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.974596 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.974518    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:54.980473 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:54.980448    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m4x6\" (UniqueName: \"kubernetes.io/projected/3b2cba67-b0c9-4e09-878c-18f93067e932-kube-api-access-6m4x6\") pod \"maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:55.118394 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:55.118317    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:55.397266 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:55.397232    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"]
Sep 08 16:56:55.398682 ip-10-0-129-146 kubenswrapper[2547]: W0908 16:56:55.398657    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b2cba67_b0c9_4e09_878c_18f93067e932.slice/crio-097f700f34a92ca67637743db0aebfbdaa726c597150970ab653e855155f35cf WatchSource:0}: Error finding container 097f700f34a92ca67637743db0aebfbdaa726c597150970ab653e855155f35cf: Status 404 returned error can't find the container with id 097f700f34a92ca67637743db0aebfbdaa726c597150970ab653e855155f35cf
Sep 08 16:56:55.520002 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:55.519971    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc" event={"ID":"3b2cba67-b0c9-4e09-878c-18f93067e932","Type":"ContainerStarted","Data":"097f700f34a92ca67637743db0aebfbdaa726c597150970ab653e855155f35cf"}
Sep 08 16:56:56.527037 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:56.527003    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc" event={"ID":"3b2cba67-b0c9-4e09-878c-18f93067e932","Type":"ContainerStarted","Data":"0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d"}
Sep 08 16:56:56.527377 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:56.527079    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:56:56.574496 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:56:56.574454    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc" podStartSLOduration=1.827361579 podStartE2EDuration="2.574439777s" totalImagesPullingTime="747.078198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:56:56.572155634 +0000 UTC m=+1612.275998632" watchObservedRunningTime="2026-09-08 16:56:56.574439777 +0000 UTC m=+1612.278282775"
Sep 08 16:57:02.537912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:02.537883    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:57:25.768895 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:25.768850    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"]
Sep 08 16:57:25.769454 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:25.769123    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc" podUID="3b2cba67-b0c9-4e09-878c-18f93067e932" containerName="maas-api" containerID="cri-o://0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d" gracePeriod=30
Sep 08 16:57:26.037878 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.037845    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:57:26.161813 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.161743    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m4x6\" (UniqueName: \"kubernetes.io/projected/3b2cba67-b0c9-4e09-878c-18f93067e932-kube-api-access-6m4x6\") pod \"3b2cba67-b0c9-4e09-878c-18f93067e932\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") "
Sep 08 16:57:26.162010 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.161872    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2cba67-b0c9-4e09-878c-18f93067e932-openshift-service-ca\") pod \"3b2cba67-b0c9-4e09-878c-18f93067e932\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") "
Sep 08 16:57:26.162010 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.161898    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-maas-api-tls\") pod \"3b2cba67-b0c9-4e09-878c-18f93067e932\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") "
Sep 08 16:57:26.162010 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.161919    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-metrics-certs\") pod \"3b2cba67-b0c9-4e09-878c-18f93067e932\" (UID: \"3b2cba67-b0c9-4e09-878c-18f93067e932\") "
Sep 08 16:57:26.162302 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.162276    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b2cba67-b0c9-4e09-878c-18f93067e932-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b2cba67-b0c9-4e09-878c-18f93067e932" (UID: "3b2cba67-b0c9-4e09-878c-18f93067e932"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:57:26.164073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.164045    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3b2cba67-b0c9-4e09-878c-18f93067e932" (UID: "3b2cba67-b0c9-4e09-878c-18f93067e932"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:57:26.164073 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.164064    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b2cba67-b0c9-4e09-878c-18f93067e932-kube-api-access-6m4x6" (OuterVolumeSpecName: "kube-api-access-6m4x6") pod "3b2cba67-b0c9-4e09-878c-18f93067e932" (UID: "3b2cba67-b0c9-4e09-878c-18f93067e932"). InnerVolumeSpecName "kube-api-access-6m4x6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:57:26.164229 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.164142    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b2cba67-b0c9-4e09-878c-18f93067e932" (UID: "3b2cba67-b0c9-4e09-878c-18f93067e932"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:57:26.263337 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.263300    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m4x6\" (UniqueName: \"kubernetes.io/projected/3b2cba67-b0c9-4e09-878c-18f93067e932-kube-api-access-6m4x6\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:26.263337 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.263333    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b2cba67-b0c9-4e09-878c-18f93067e932-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:26.263337 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.263344    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:26.263590 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.263353    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b2cba67-b0c9-4e09-878c-18f93067e932-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:26.693050 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.693011    2547 generic.go:356] "Generic (PLEG): container finished" podID="3b2cba67-b0c9-4e09-878c-18f93067e932" containerID="0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d" exitCode=0
Sep 08 16:57:26.693222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.693062    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"
Sep 08 16:57:26.693222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.693102    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc" event={"ID":"3b2cba67-b0c9-4e09-878c-18f93067e932","Type":"ContainerDied","Data":"0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d"}
Sep 08 16:57:26.693222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.693189    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc" event={"ID":"3b2cba67-b0c9-4e09-878c-18f93067e932","Type":"ContainerDied","Data":"097f700f34a92ca67637743db0aebfbdaa726c597150970ab653e855155f35cf"}
Sep 08 16:57:26.693222 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.693213    2547 scope.go:117] "RemoveContainer" containerID="0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d"
Sep 08 16:57:26.703074 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.703057    2547 scope.go:117] "RemoveContainer" containerID="0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d"
Sep 08 16:57:26.703367 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:57:26.703347    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d\": container with ID starting with 0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d not found: ID does not exist" containerID="0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d"
Sep 08 16:57:26.703423 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.703375    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d"} err="failed to get container status \"0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d\": rpc error: code = NotFound desc = could not find container \"0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d\": container with ID starting with 0e2db1a9a82fe34a9c54a118c2c228285ff9c14467332834cccf405c69df978d not found: ID does not exist"
Sep 08 16:57:26.739236 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.739202    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"]
Sep 08 16:57:26.743968 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.743945    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-a0a70f-d9585fd74-vtqfc"]
Sep 08 16:57:26.833361 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:26.833332    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b2cba67-b0c9-4e09-878c-18f93067e932" path="/var/lib/kubelet/pods/3b2cba67-b0c9-4e09-878c-18f93067e932/volumes"
Sep 08 16:57:54.579638 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.579602    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"]
Sep 08 16:57:54.580153 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.579843    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb" podUID="c739cf17-9703-4a4d-837b-8370db98a3bf" containerName="maas-api" containerID="cri-o://26eec40c0e7d6d97aa8731f559a9d52e37b1fbd6dd423cb7f57fc73ec714ae40" gracePeriod=30
Sep 08 16:57:54.669184 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.669147    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"]
Sep 08 16:57:54.669479 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.669420    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c" podUID="f3caa66e-186a-4b05-9e4c-6406f718c8c6" containerName="payload-pre-processing" containerID="cri-o://adccf208d1b06c42f38df3a807bf7e209502460b3021d7eab789f21608275575" gracePeriod=30
Sep 08 16:57:54.860799 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.860751    2547 generic.go:356] "Generic (PLEG): container finished" podID="f3caa66e-186a-4b05-9e4c-6406f718c8c6" containerID="adccf208d1b06c42f38df3a807bf7e209502460b3021d7eab789f21608275575" exitCode=0
Sep 08 16:57:54.860963 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.860812    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c" event={"ID":"f3caa66e-186a-4b05-9e4c-6406f718c8c6","Type":"ContainerDied","Data":"adccf208d1b06c42f38df3a807bf7e209502460b3021d7eab789f21608275575"}
Sep 08 16:57:54.862523 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.862499    2547 generic.go:356] "Generic (PLEG): container finished" podID="c739cf17-9703-4a4d-837b-8370db98a3bf" containerID="26eec40c0e7d6d97aa8731f559a9d52e37b1fbd6dd423cb7f57fc73ec714ae40" exitCode=0
Sep 08 16:57:54.862674 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.862556    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb" event={"ID":"c739cf17-9703-4a4d-837b-8370db98a3bf","Type":"ContainerDied","Data":"26eec40c0e7d6d97aa8731f559a9d52e37b1fbd6dd423cb7f57fc73ec714ae40"}
Sep 08 16:57:54.934101 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.934075    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:57:54.954912 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:54.954836    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:57:55.029143 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029114    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfwv2\" (UniqueName: \"kubernetes.io/projected/c739cf17-9703-4a4d-837b-8370db98a3bf-kube-api-access-tfwv2\") pod \"c739cf17-9703-4a4d-837b-8370db98a3bf\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") "
Sep 08 16:57:55.029313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029170    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-maas-api-tls\") pod \"c739cf17-9703-4a4d-837b-8370db98a3bf\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") "
Sep 08 16:57:55.029313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029213    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c739cf17-9703-4a4d-837b-8370db98a3bf-openshift-service-ca\") pod \"c739cf17-9703-4a4d-837b-8370db98a3bf\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") "
Sep 08 16:57:55.029313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029235    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3caa66e-186a-4b05-9e4c-6406f718c8c6-plugins-config-volume\") pod \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") "
Sep 08 16:57:55.029313 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029257    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwbjq\" (UniqueName: \"kubernetes.io/projected/f3caa66e-186a-4b05-9e4c-6406f718c8c6-kube-api-access-fwbjq\") pod \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\" (UID: \"f3caa66e-186a-4b05-9e4c-6406f718c8c6\") "
Sep 08 16:57:55.029518 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029328    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-metrics-certs\") pod \"c739cf17-9703-4a4d-837b-8370db98a3bf\" (UID: \"c739cf17-9703-4a4d-837b-8370db98a3bf\") "
Sep 08 16:57:55.029637 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029610    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c739cf17-9703-4a4d-837b-8370db98a3bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c739cf17-9703-4a4d-837b-8370db98a3bf" (UID: "c739cf17-9703-4a4d-837b-8370db98a3bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:57:55.029729 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.029637    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3caa66e-186a-4b05-9e4c-6406f718c8c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3caa66e-186a-4b05-9e4c-6406f718c8c6" (UID: "f3caa66e-186a-4b05-9e4c-6406f718c8c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:57:55.031477 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.031444    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3caa66e-186a-4b05-9e4c-6406f718c8c6-kube-api-access-fwbjq" (OuterVolumeSpecName: "kube-api-access-fwbjq") pod "f3caa66e-186a-4b05-9e4c-6406f718c8c6" (UID: "f3caa66e-186a-4b05-9e4c-6406f718c8c6"). InnerVolumeSpecName "kube-api-access-fwbjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:57:55.031584 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.031505    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c739cf17-9703-4a4d-837b-8370db98a3bf-kube-api-access-tfwv2" (OuterVolumeSpecName: "kube-api-access-tfwv2") pod "c739cf17-9703-4a4d-837b-8370db98a3bf" (UID: "c739cf17-9703-4a4d-837b-8370db98a3bf"). InnerVolumeSpecName "kube-api-access-tfwv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:57:55.031584 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.031546    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c739cf17-9703-4a4d-837b-8370db98a3bf" (UID: "c739cf17-9703-4a4d-837b-8370db98a3bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:57:55.031709 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.031693    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c739cf17-9703-4a4d-837b-8370db98a3bf" (UID: "c739cf17-9703-4a4d-837b-8370db98a3bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:57:55.131140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.131048    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c739cf17-9703-4a4d-837b-8370db98a3bf-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:55.131140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.131077    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3caa66e-186a-4b05-9e4c-6406f718c8c6-plugins-config-volume\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:55.131140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.131090    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwbjq\" (UniqueName: \"kubernetes.io/projected/f3caa66e-186a-4b05-9e4c-6406f718c8c6-kube-api-access-fwbjq\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:55.131140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.131102    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:55.131140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.131113    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfwv2\" (UniqueName: \"kubernetes.io/projected/c739cf17-9703-4a4d-837b-8370db98a3bf-kube-api-access-tfwv2\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:55.131140 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.131126    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c739cf17-9703-4a4d-837b-8370db98a3bf-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:57:55.868975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.868887    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"
Sep 08 16:57:55.868975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.868918    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c" event={"ID":"f3caa66e-186a-4b05-9e4c-6406f718c8c6","Type":"ContainerDied","Data":"2ad26a3d911c1abf7de719697205d5229efbfee42f41002543727d9e603467be"}
Sep 08 16:57:55.868975 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.868972    2547 scope.go:117] "RemoveContainer" containerID="adccf208d1b06c42f38df3a807bf7e209502460b3021d7eab789f21608275575"
Sep 08 16:57:55.870352 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.870323    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"
Sep 08 16:57:55.870352 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.870336    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb" event={"ID":"c739cf17-9703-4a4d-837b-8370db98a3bf","Type":"ContainerDied","Data":"c41675e6c05ed297bbc4bb54ca5f10ff071aa250f6769ebe9b9782457a29c3f0"}
Sep 08 16:57:55.879758 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.879741    2547 scope.go:117] "RemoveContainer" containerID="26eec40c0e7d6d97aa8731f559a9d52e37b1fbd6dd423cb7f57fc73ec714ae40"
Sep 08 16:57:55.894138 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.894116    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"]
Sep 08 16:57:55.902362 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.902340    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d2b1cc-7789bbdd5d-ktm6c"]
Sep 08 16:57:55.914568 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.914545    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"]
Sep 08 16:57:55.921217 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:55.921194    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-d2b1cc-584c4b54dc-2l7wb"]
Sep 08 16:57:56.833800 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:56.833755    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c739cf17-9703-4a4d-837b-8370db98a3bf" path="/var/lib/kubelet/pods/c739cf17-9703-4a4d-837b-8370db98a3bf/volumes"
Sep 08 16:57:56.834154 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:57:56.834140    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3caa66e-186a-4b05-9e4c-6406f718c8c6" path="/var/lib/kubelet/pods/f3caa66e-186a-4b05-9e4c-6406f718c8c6/volumes"
Sep 08 16:59:37.916181 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:37.916145    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"]
Sep 08 16:59:37.916729 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:37.916417    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l" podUID="b1573cdd-6ed0-4968-adaa-93832c134e4c" containerName="maas-api" containerID="cri-o://85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af" gracePeriod=30
Sep 08 16:59:38.158304 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.158272    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:59:38.246950 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.246876    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-maas-api-tls\") pod \"b1573cdd-6ed0-4968-adaa-93832c134e4c\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") "
Sep 08 16:59:38.246950 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.246935    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1573cdd-6ed0-4968-adaa-93832c134e4c-openshift-service-ca\") pod \"b1573cdd-6ed0-4968-adaa-93832c134e4c\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") "
Sep 08 16:59:38.247116 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.246992    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-metrics-certs\") pod \"b1573cdd-6ed0-4968-adaa-93832c134e4c\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") "
Sep 08 16:59:38.247116 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.247019    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb7hz\" (UniqueName: \"kubernetes.io/projected/b1573cdd-6ed0-4968-adaa-93832c134e4c-kube-api-access-wb7hz\") pod \"b1573cdd-6ed0-4968-adaa-93832c134e4c\" (UID: \"b1573cdd-6ed0-4968-adaa-93832c134e4c\") "
Sep 08 16:59:38.247298 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.247275    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1573cdd-6ed0-4968-adaa-93832c134e4c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1573cdd-6ed0-4968-adaa-93832c134e4c" (UID: "b1573cdd-6ed0-4968-adaa-93832c134e4c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:59:38.249201 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.249170    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b1573cdd-6ed0-4968-adaa-93832c134e4c" (UID: "b1573cdd-6ed0-4968-adaa-93832c134e4c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:59:38.249307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.249199    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1573cdd-6ed0-4968-adaa-93832c134e4c" (UID: "b1573cdd-6ed0-4968-adaa-93832c134e4c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:59:38.249307 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.249212    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1573cdd-6ed0-4968-adaa-93832c134e4c-kube-api-access-wb7hz" (OuterVolumeSpecName: "kube-api-access-wb7hz") pod "b1573cdd-6ed0-4968-adaa-93832c134e4c" (UID: "b1573cdd-6ed0-4968-adaa-93832c134e4c"). InnerVolumeSpecName "kube-api-access-wb7hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:38.348340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.348295    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:38.348340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.348333    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb7hz\" (UniqueName: \"kubernetes.io/projected/b1573cdd-6ed0-4968-adaa-93832c134e4c-kube-api-access-wb7hz\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:38.348340 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.348345    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1573cdd-6ed0-4968-adaa-93832c134e4c-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:38.348564 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.348357    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1573cdd-6ed0-4968-adaa-93832c134e4c-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:38.429689 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.429660    2547 generic.go:356] "Generic (PLEG): container finished" podID="b1573cdd-6ed0-4968-adaa-93832c134e4c" containerID="85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af" exitCode=0
Sep 08 16:59:38.429869 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.429731    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l" event={"ID":"b1573cdd-6ed0-4968-adaa-93832c134e4c","Type":"ContainerDied","Data":"85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af"}
Sep 08 16:59:38.429869 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.429771    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l" event={"ID":"b1573cdd-6ed0-4968-adaa-93832c134e4c","Type":"ContainerDied","Data":"60b8f131f4188e5bdba1681daebd277f27b1abc7407b9cce8bb6f107352ae6cc"}
Sep 08 16:59:38.429869 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.429770    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"
Sep 08 16:59:38.429869 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.429812    2547 scope.go:117] "RemoveContainer" containerID="85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af"
Sep 08 16:59:38.441573 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.441552    2547 scope.go:117] "RemoveContainer" containerID="85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af"
Sep 08 16:59:38.441878 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:59:38.441856    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af\": container with ID starting with 85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af not found: ID does not exist" containerID="85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af"
Sep 08 16:59:38.441957 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.441889    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af"} err="failed to get container status \"85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af\": rpc error: code = NotFound desc = could not find container \"85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af\": container with ID starting with 85462b7bc689e621fc4c6d9e08ad3064003b31d4b7db081f272477a012f360af not found: ID does not exist"
Sep 08 16:59:38.454965 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.454941    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"]
Sep 08 16:59:38.461378 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.461351    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-608268-754b54768c-lxg7l"]
Sep 08 16:59:38.833183 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:38.833146    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1573cdd-6ed0-4968-adaa-93832c134e4c" path="/var/lib/kubelet/pods/b1573cdd-6ed0-4968-adaa-93832c134e4c/volumes"
Sep 08 16:59:56.066629 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.066537    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"]
Sep 08 16:59:56.067150 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.066773    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" podUID="ae94a3f5-05d8-473a-8ecc-2a8f5202b504" containerName="maas-api" containerID="cri-o://eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117" gracePeriod=30
Sep 08 16:59:56.299296 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.299273    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:59:56.301820 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.301760    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w422v\" (UniqueName: \"kubernetes.io/projected/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-kube-api-access-w422v\") pod \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") "
Sep 08 16:59:56.301820 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.301806    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-openshift-service-ca\") pod \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") "
Sep 08 16:59:56.302011 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.301880    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls\") pod \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") "
Sep 08 16:59:56.302011 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.301924    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-metrics-certs\") pod \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\" (UID: \"ae94a3f5-05d8-473a-8ecc-2a8f5202b504\") "
Sep 08 16:59:56.302181 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.302159    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae94a3f5-05d8-473a-8ecc-2a8f5202b504" (UID: "ae94a3f5-05d8-473a-8ecc-2a8f5202b504"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:59:56.303968 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.303942    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-kube-api-access-w422v" (OuterVolumeSpecName: "kube-api-access-w422v") pod "ae94a3f5-05d8-473a-8ecc-2a8f5202b504" (UID: "ae94a3f5-05d8-473a-8ecc-2a8f5202b504"). InnerVolumeSpecName "kube-api-access-w422v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:56.304049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.303970    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ae94a3f5-05d8-473a-8ecc-2a8f5202b504" (UID: "ae94a3f5-05d8-473a-8ecc-2a8f5202b504"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:59:56.304049 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.303980    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae94a3f5-05d8-473a-8ecc-2a8f5202b504" (UID: "ae94a3f5-05d8-473a-8ecc-2a8f5202b504"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:59:56.402577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.402504    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:56.402577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.402527    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w422v\" (UniqueName: \"kubernetes.io/projected/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-kube-api-access-w422v\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:56.402577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.402538    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:56.402577 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.402548    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae94a3f5-05d8-473a-8ecc-2a8f5202b504-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 16:59:56.527795 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.527754    2547 generic.go:356] "Generic (PLEG): container finished" podID="ae94a3f5-05d8-473a-8ecc-2a8f5202b504" containerID="eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117" exitCode=0
Sep 08 16:59:56.527985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.527823    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"
Sep 08 16:59:56.527985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.527844    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" event={"ID":"ae94a3f5-05d8-473a-8ecc-2a8f5202b504","Type":"ContainerDied","Data":"eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117"}
Sep 08 16:59:56.527985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.527907    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c" event={"ID":"ae94a3f5-05d8-473a-8ecc-2a8f5202b504","Type":"ContainerDied","Data":"123b6bde73bed2f948f5852d53a4db60ead9a7c603d63ca0c4a1d7cc0542cd16"}
Sep 08 16:59:56.527985 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.527938    2547 scope.go:117] "RemoveContainer" containerID="eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117"
Sep 08 16:59:56.537634 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.537613    2547 scope.go:117] "RemoveContainer" containerID="eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117"
Sep 08 16:59:56.537908 ip-10-0-129-146 kubenswrapper[2547]: E0908 16:59:56.537887    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117\": container with ID starting with eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117 not found: ID does not exist" containerID="eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117"
Sep 08 16:59:56.537972 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.537919    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117"} err="failed to get container status \"eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117\": rpc error: code = NotFound desc = could not find container \"eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117\": container with ID starting with eba82f50f130261cfa49c74ef0ee01663191e2897283b84bbc5835e7df51d117 not found: ID does not exist"
Sep 08 16:59:56.549360 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.549339    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"]
Sep 08 16:59:56.555293 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.555270    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-6b15ca-6f488fdbc6-tcw2c"]
Sep 08 16:59:56.833272 ip-10-0-129-146 kubenswrapper[2547]: I0908 16:59:56.833244    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae94a3f5-05d8-473a-8ecc-2a8f5202b504" path="/var/lib/kubelet/pods/ae94a3f5-05d8-473a-8ecc-2a8f5202b504/volumes"
Sep 08 17:00:05.776094 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:00:05.776067    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 17:00:05.781127 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:00:05.781104    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 17:00:05.901340 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:00:05.901311    2547 scope.go:117] "RemoveContainer" containerID="4fa5c6077630bf5cdef2401390e8bdf1e48ebe414d36177a55a593533c6e39ad"
Sep 08 17:05:05.822691 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:05.822656    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 17:05:05.826572 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:05.826546    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 17:05:34.798159 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798124    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"]
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798494    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1573cdd-6ed0-4968-adaa-93832c134e4c" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798506    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1573cdd-6ed0-4968-adaa-93832c134e4c" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798521    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c739cf17-9703-4a4d-837b-8370db98a3bf" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798526    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c739cf17-9703-4a4d-837b-8370db98a3bf" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798533    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b2cba67-b0c9-4e09-878c-18f93067e932" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798538    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b2cba67-b0c9-4e09-878c-18f93067e932" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798545    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3caa66e-186a-4b05-9e4c-6406f718c8c6" containerName="payload-pre-processing"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798551    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3caa66e-186a-4b05-9e4c-6406f718c8c6" containerName="payload-pre-processing"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798565    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798570    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798578    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae94a3f5-05d8-473a-8ecc-2a8f5202b504" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798582    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae94a3f5-05d8-473a-8ecc-2a8f5202b504" containerName="maas-api"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798640    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8997f0-3c6e-4011-aba8-5e819610eecf" containerName="istio-proxy"
Sep 08 17:05:34.798641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798647    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3caa66e-186a-4b05-9e4c-6406f718c8c6" containerName="payload-pre-processing"
Sep 08 17:05:34.799138 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798652    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1573cdd-6ed0-4968-adaa-93832c134e4c" containerName="maas-api"
Sep 08 17:05:34.799138 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798660    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c739cf17-9703-4a4d-837b-8370db98a3bf" containerName="maas-api"
Sep 08 17:05:34.799138 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798665    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae94a3f5-05d8-473a-8ecc-2a8f5202b504" containerName="maas-api"
Sep 08 17:05:34.799138 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.798671    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b2cba67-b0c9-4e09-878c-18f93067e932" containerName="maas-api"
Sep 08 17:05:34.801749 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.801732    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.804163 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.804142    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dzvtd\""
Sep 08 17:05:34.804948 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.804928    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 17:05:34.805079 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.804935    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 17:05:34.816524 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.816490    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"]
Sep 08 17:05:34.869148 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.869106    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtl8f\" (UniqueName: \"kubernetes.io/projected/795fe628-e73a-4346-8a61-380aa9168b73-kube-api-access-mtl8f\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.869337 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.869161    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-metrics-certs\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.869337 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.869278    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795fe628-e73a-4346-8a61-380aa9168b73-openshift-service-ca\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.869337 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.869313    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-maas-api-tls\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.970238 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.970196    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtl8f\" (UniqueName: \"kubernetes.io/projected/795fe628-e73a-4346-8a61-380aa9168b73-kube-api-access-mtl8f\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.970420 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.970253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-metrics-certs\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.970420 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.970306    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795fe628-e73a-4346-8a61-380aa9168b73-openshift-service-ca\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.970420 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.970323    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-maas-api-tls\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.971206 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.971067    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795fe628-e73a-4346-8a61-380aa9168b73-openshift-service-ca\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.973040 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.973011    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-metrics-certs\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.973138 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.973018    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-maas-api-tls\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:34.978573 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:34.978550    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtl8f\" (UniqueName: \"kubernetes.io/projected/795fe628-e73a-4346-8a61-380aa9168b73-kube-api-access-mtl8f\") pod \"maas-api-7d686bf8c4-n78f2\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:35.113031 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:35.112929    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:35.397096 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:35.397062    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"]
Sep 08 17:05:35.398773 ip-10-0-129-146 kubenswrapper[2547]: W0908 17:05:35.398726    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795fe628_e73a_4346_8a61_380aa9168b73.slice/crio-c8864bd4c48133553f8f7a5403935ff8c9e6c25de1d4c97fbf92bb4913cf0f29 WatchSource:0}: Error finding container c8864bd4c48133553f8f7a5403935ff8c9e6c25de1d4c97fbf92bb4913cf0f29: Status 404 returned error can't find the container with id c8864bd4c48133553f8f7a5403935ff8c9e6c25de1d4c97fbf92bb4913cf0f29
Sep 08 17:05:35.400085 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:35.400068    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 17:05:36.352023 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:36.351977    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2" event={"ID":"795fe628-e73a-4346-8a61-380aa9168b73","Type":"ContainerStarted","Data":"3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37"}
Sep 08 17:05:36.352505 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:36.352076    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2" event={"ID":"795fe628-e73a-4346-8a61-380aa9168b73","Type":"ContainerStarted","Data":"c8864bd4c48133553f8f7a5403935ff8c9e6c25de1d4c97fbf92bb4913cf0f29"}
Sep 08 17:05:36.352505 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:36.352186    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:36.372839 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:36.372763    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2" podStartSLOduration=1.915474173 podStartE2EDuration="2.372747526s" totalImagesPullingTime="457.273353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 17:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:05:36.370886715 +0000 UTC m=+2132.074729716" watchObservedRunningTime="2026-09-08 17:05:36.372747526 +0000 UTC m=+2132.076590526"
Sep 08 17:05:42.341812 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.341043    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"]
Sep 08 17:05:42.341812 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.341376    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2" podUID="795fe628-e73a-4346-8a61-380aa9168b73" containerName="maas-api" containerID="cri-o://3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37" gracePeriod=30
Sep 08 17:05:42.348682 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.348655    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:42.381294 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.381265    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"]
Sep 08 17:05:42.384824 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.384804    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.399170 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.399139    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"]
Sep 08 17:05:42.440045 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.440011    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44955a67-da37-4322-a543-a9d478ed754e-openshift-service-ca\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.440214 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.440065    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44955a67-da37-4322-a543-a9d478ed754e-maas-api-tls\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.440214 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.440127    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwthx\" (UniqueName: \"kubernetes.io/projected/44955a67-da37-4322-a543-a9d478ed754e-kube-api-access-xwthx\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.440214 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.440144    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44955a67-da37-4322-a543-a9d478ed754e-metrics-certs\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.541474 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.541431    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwthx\" (UniqueName: \"kubernetes.io/projected/44955a67-da37-4322-a543-a9d478ed754e-kube-api-access-xwthx\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.541474 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.541477    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44955a67-da37-4322-a543-a9d478ed754e-metrics-certs\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.541677 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.541548    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44955a67-da37-4322-a543-a9d478ed754e-openshift-service-ca\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.541677 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.541592    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44955a67-da37-4322-a543-a9d478ed754e-maas-api-tls\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.542404 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.542314    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44955a67-da37-4322-a543-a9d478ed754e-openshift-service-ca\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.544359 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.544323    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44955a67-da37-4322-a543-a9d478ed754e-maas-api-tls\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.544470 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.544393    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/44955a67-da37-4322-a543-a9d478ed754e-metrics-certs\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.550394 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.550369    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwthx\" (UniqueName: \"kubernetes.io/projected/44955a67-da37-4322-a543-a9d478ed754e-kube-api-access-xwthx\") pod \"maas-api-75ccb5ffc4-q7k4v\" (UID: \"44955a67-da37-4322-a543-a9d478ed754e\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.602831 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.602739    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:42.732548 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.732512    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:42.743607 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.743577    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-maas-api-tls\") pod \"795fe628-e73a-4346-8a61-380aa9168b73\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") "
Sep 08 17:05:42.743713 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.743669    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtl8f\" (UniqueName: \"kubernetes.io/projected/795fe628-e73a-4346-8a61-380aa9168b73-kube-api-access-mtl8f\") pod \"795fe628-e73a-4346-8a61-380aa9168b73\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") "
Sep 08 17:05:42.743798 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.743725    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-metrics-certs\") pod \"795fe628-e73a-4346-8a61-380aa9168b73\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") "
Sep 08 17:05:42.743853 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.743841    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795fe628-e73a-4346-8a61-380aa9168b73-openshift-service-ca\") pod \"795fe628-e73a-4346-8a61-380aa9168b73\" (UID: \"795fe628-e73a-4346-8a61-380aa9168b73\") "
Sep 08 17:05:42.744498 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.744223    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/795fe628-e73a-4346-8a61-380aa9168b73-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "795fe628-e73a-4346-8a61-380aa9168b73" (UID: "795fe628-e73a-4346-8a61-380aa9168b73"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 17:05:42.745912 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.745883    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "795fe628-e73a-4346-8a61-380aa9168b73" (UID: "795fe628-e73a-4346-8a61-380aa9168b73"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:05:42.746012 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.745947    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/795fe628-e73a-4346-8a61-380aa9168b73-kube-api-access-mtl8f" (OuterVolumeSpecName: "kube-api-access-mtl8f") pod "795fe628-e73a-4346-8a61-380aa9168b73" (UID: "795fe628-e73a-4346-8a61-380aa9168b73"). InnerVolumeSpecName "kube-api-access-mtl8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 17:05:42.746012 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.745969    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "795fe628-e73a-4346-8a61-380aa9168b73" (UID: "795fe628-e73a-4346-8a61-380aa9168b73"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:05:42.844675 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.844647    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-maas-api-tls\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 17:05:42.844675 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.844674    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtl8f\" (UniqueName: \"kubernetes.io/projected/795fe628-e73a-4346-8a61-380aa9168b73-kube-api-access-mtl8f\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 17:05:42.844868 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.844684    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/795fe628-e73a-4346-8a61-380aa9168b73-metrics-certs\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 17:05:42.844868 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:42.844692    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/795fe628-e73a-4346-8a61-380aa9168b73-openshift-service-ca\") on node \"ip-10-0-129-146.ec2.internal\" DevicePath \"\""
Sep 08 17:05:43.012807 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.012763    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"]
Sep 08 17:05:43.016123 ip-10-0-129-146 kubenswrapper[2547]: W0908 17:05:43.016092    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44955a67_da37_4322_a543_a9d478ed754e.slice/crio-33dcd0bc162efaac8b3b0dde4977948362b7b891a516fb4e4b14fc695086f861 WatchSource:0}: Error finding container 33dcd0bc162efaac8b3b0dde4977948362b7b891a516fb4e4b14fc695086f861: Status 404 returned error can't find the container with id 33dcd0bc162efaac8b3b0dde4977948362b7b891a516fb4e4b14fc695086f861
Sep 08 17:05:43.390851 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.390813    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v" event={"ID":"44955a67-da37-4322-a543-a9d478ed754e","Type":"ContainerStarted","Data":"33dcd0bc162efaac8b3b0dde4977948362b7b891a516fb4e4b14fc695086f861"}
Sep 08 17:05:43.392148 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.392121    2547 generic.go:356] "Generic (PLEG): container finished" podID="795fe628-e73a-4346-8a61-380aa9168b73" containerID="3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37" exitCode=0
Sep 08 17:05:43.392253 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.392168    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"
Sep 08 17:05:43.392253 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.392202    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2" event={"ID":"795fe628-e73a-4346-8a61-380aa9168b73","Type":"ContainerDied","Data":"3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37"}
Sep 08 17:05:43.392344 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.392259    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2" event={"ID":"795fe628-e73a-4346-8a61-380aa9168b73","Type":"ContainerDied","Data":"c8864bd4c48133553f8f7a5403935ff8c9e6c25de1d4c97fbf92bb4913cf0f29"}
Sep 08 17:05:43.392344 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.392282    2547 scope.go:117] "RemoveContainer" containerID="3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37"
Sep 08 17:05:43.406891 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.406868    2547 scope.go:117] "RemoveContainer" containerID="3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37"
Sep 08 17:05:43.407234 ip-10-0-129-146 kubenswrapper[2547]: E0908 17:05:43.407215    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37\": container with ID starting with 3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37 not found: ID does not exist" containerID="3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37"
Sep 08 17:05:43.407289 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.407246    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37"} err="failed to get container status \"3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37\": rpc error: code = NotFound desc = could not find container \"3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37\": container with ID starting with 3c380c703ffeadd0d3ab758dd345fbed9703cc45065e2c5b414ca6e5af13dd37 not found: ID does not exist"
Sep 08 17:05:43.440765 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.440735    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"]
Sep 08 17:05:43.443106 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:43.443085    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-n78f2"]
Sep 08 17:05:44.400461 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:44.400425    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v" event={"ID":"44955a67-da37-4322-a543-a9d478ed754e","Type":"ContainerStarted","Data":"d3a4421d96571558896025dc9809d12a506ac0fed11652754f0bdb0b6613dfab"}
Sep 08 17:05:44.400866 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:44.400555    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:05:44.423710 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:44.423652    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v" podStartSLOduration=2.06061121 podStartE2EDuration="2.423635719s" totalImagesPullingTime="363.024509ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 17:05:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:05:44.420714291 +0000 UTC m=+2140.124557304" watchObservedRunningTime="2026-09-08 17:05:44.423635719 +0000 UTC m=+2140.127478730"
Sep 08 17:05:44.834979 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:44.834936    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="795fe628-e73a-4346-8a61-380aa9168b73" path="/var/lib/kubelet/pods/795fe628-e73a-4346-8a61-380aa9168b73/volumes"
Sep 08 17:05:50.411864 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:05:50.411837    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-q7k4v"
Sep 08 17:06:03.144983 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:03.144899    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f999b88d7-x52gs_bd9a2722-d87f-49ea-b35d-c250ed11db2c/authorino/0.log"
Sep 08 17:06:09.421106 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:09.421076    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-fqqgd_138ee252-68d1-4558-b0ad-13833bb4cfa8/copy-manifests/0.log"
Sep 08 17:06:09.433976 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:09.433946    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-fqqgd_138ee252-68d1-4558-b0ad-13833bb4cfa8/manager/0.log"
Sep 08 17:06:10.171146 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:10.171116    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75ccb5ffc4-q7k4v_44955a67-da37-4322-a543-a9d478ed754e/maas-api/0.log"
Sep 08 17:06:10.517631 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:10.517544    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-ftzj6_364c8320-ab13-4799-950a-c68e3c21fb83/postgres/0.log"
Sep 08 17:06:11.319406 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:11.319375    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f999b88d7-x52gs_bd9a2722-d87f-49ea-b35d-c250ed11db2c/authorino/0.log"
Sep 08 17:06:12.707177 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:12.707146    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7469867b85-2mtrm_2ee227a7-72da-4884-a3ed-afe188443ae8/kube-auth-proxy/0.log"
Sep 08 17:06:13.063067 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:13.063036    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pj92q_159ee2ab-6424-4294-80a7-440298e1ad38/payload-pre-processing/0.log"
Sep 08 17:06:13.310450 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:13.310418    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb6f6fcf8-cxp7q_272ce978-010b-40c1-bfa8-6e273be82289/router/0.log"
Sep 08 17:06:13.666713 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:13.666679    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5pzks_30311391-a03d-4830-ac94-1125a8513266/main/0.log"
Sep 08 17:06:13.776076 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:13.776047    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-kcs6m_1ee1c887-bebf-4914-9da1-6b6a0f82b5d3/main/0.log"
Sep 08 17:06:14.002968 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:14.002890    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-m9mtq_249b124f-848d-4bf8-8084-4870090f9eba/main/0.log"
Sep 08 17:06:14.332511 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:14.332481    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-k6bxl_7120855d-0caa-40b7-941f-67356ee2713e/main/0.log"
Sep 08 17:06:24.409056 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:24.409019    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qkf2f_b8c71dfb-970d-456f-9524-ed93a7904850/global-pull-secret-syncer/0.log"
Sep 08 17:06:24.540019 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:24.539992    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zkxfs_c70a299b-1c8a-4402-8c72-881dc3e73ab8/konnectivity-agent/0.log"
Sep 08 17:06:24.561197 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:24.561165    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-146.ec2.internal_3942b755a80943cc8a080b1a44e287c8/haproxy/0.log"
Sep 08 17:06:29.814246 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:29.814211    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f999b88d7-x52gs_bd9a2722-d87f-49ea-b35d-c250ed11db2c/authorino/0.log"
Sep 08 17:06:31.748360 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:31.748330    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-zljt7_543034bc-8c58-4864-a980-69b199df8d54/cluster-monitoring-operator/0.log"
Sep 08 17:06:32.084691 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.084659    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7g8ph_03c5cda6-7c43-400d-ac5c-e584c633f3fd/node-exporter/0.log"
Sep 08 17:06:32.109001 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.108973    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7g8ph_03c5cda6-7c43-400d-ac5c-e584c633f3fd/kube-rbac-proxy/0.log"
Sep 08 17:06:32.130641 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.130618    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7g8ph_03c5cda6-7c43-400d-ac5c-e584c633f3fd/init-textfile/0.log"
Sep 08 17:06:32.548082 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.548052    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-jl4p6_e521574f-831f-4435-ab7a-973e9586eb10/prometheus-operator-admission-webhook/0.log"
Sep 08 17:06:32.585945 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.585912    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bd5bd998-bwdcp_916a2fd1-f969-4bcc-b25c-3867c7d1e1e1/telemeter-client/0.log"
Sep 08 17:06:32.608300 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.608270    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bd5bd998-bwdcp_916a2fd1-f969-4bcc-b25c-3867c7d1e1e1/reload/0.log"
Sep 08 17:06:32.667231 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:32.667204    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6bd5bd998-bwdcp_916a2fd1-f969-4bcc-b25c-3867c7d1e1e1/kube-rbac-proxy/0.log"
Sep 08 17:06:34.025479 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:34.025445    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-tfrmw_aace608b-8d23-4025-8571-bccbfcd09df0/networking-console-plugin/0.log"
Sep 08 17:06:34.671274 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:34.671245    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/1.log"
Sep 08 17:06:34.675353 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:34.675324    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-hm59v_736abb7e-7095-4c23-b845-0d1de077de57/console-operator/2.log"
Sep 08 17:06:35.151569 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.151526    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"]
Sep 08 17:06:35.151945 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.151918    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="795fe628-e73a-4346-8a61-380aa9168b73" containerName="maas-api"
Sep 08 17:06:35.151945 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.151930    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="795fe628-e73a-4346-8a61-380aa9168b73" containerName="maas-api"
Sep 08 17:06:35.152039 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.151993    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="795fe628-e73a-4346-8a61-380aa9168b73" containerName="maas-api"
Sep 08 17:06:35.155369 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.155348    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.157566 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.157542    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6s2hc\"/\"default-dockercfg-gwsmc\""
Sep 08 17:06:35.157702 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.157549    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6s2hc\"/\"kube-root-ca.crt\""
Sep 08 17:06:35.158226 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.158209    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6s2hc\"/\"openshift-service-ca.crt\""
Sep 08 17:06:35.164509 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.164483    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"]
Sep 08 17:06:35.242879 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.242839    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-sys\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.243092 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.242927    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-proc\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.243092 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.242985    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-podres\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.243092 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.243021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxxrv\" (UniqueName: \"kubernetes.io/projected/42316b0d-aeb5-4aba-b58d-31693af862cb-kube-api-access-wxxrv\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.243232 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.243111    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-lib-modules\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.317599 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.317566    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-q7pvt_15884538-8cdf-4bfe-83a3-2161bf92b896/download-server/0.log"
Sep 08 17:06:35.344564 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344530    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-proc\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.344564 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344574    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-podres\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.344891 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344612    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxxrv\" (UniqueName: \"kubernetes.io/projected/42316b0d-aeb5-4aba-b58d-31693af862cb-kube-api-access-wxxrv\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.344891 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344663    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-proc\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.344891 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344668    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-lib-modules\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.344891 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344747    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-sys\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.344891 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344821    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-lib-modules\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.345104 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344901    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-sys\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.345104 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.344924    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42316b0d-aeb5-4aba-b58d-31693af862cb-podres\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.354447 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.354418    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxxrv\" (UniqueName: \"kubernetes.io/projected/42316b0d-aeb5-4aba-b58d-31693af862cb-kube-api-access-wxxrv\") pod \"perf-node-gather-daemonset-5hsbb\" (UID: \"42316b0d-aeb5-4aba-b58d-31693af862cb\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.466670 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.466572    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:35.747070 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:35.747037    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"]
Sep 08 17:06:35.748408 ip-10-0-129-146 kubenswrapper[2547]: W0908 17:06:35.748375    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42316b0d_aeb5_4aba_b58d_31693af862cb.slice/crio-78dadcd6136800e2c45fe495d5627718582f462e67a6f19591873fbd3a9b673d WatchSource:0}: Error finding container 78dadcd6136800e2c45fe495d5627718582f462e67a6f19591873fbd3a9b673d: Status 404 returned error can't find the container with id 78dadcd6136800e2c45fe495d5627718582f462e67a6f19591873fbd3a9b673d
Sep 08 17:06:36.034620 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:36.034590    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-s44v8_f2e3ee59-cc2b-493f-a3af-71c39a1ac74d/volume-data-source-validator/0.log"
Sep 08 17:06:36.687223 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:36.687187    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb" event={"ID":"42316b0d-aeb5-4aba-b58d-31693af862cb","Type":"ContainerStarted","Data":"78c228acadc59b0bf39fd7c0088f5c2a15597dd96d3f20db2a9e81574d1b9fd1"}
Sep 08 17:06:36.687664 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:36.687235    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb" event={"ID":"42316b0d-aeb5-4aba-b58d-31693af862cb","Type":"ContainerStarted","Data":"78dadcd6136800e2c45fe495d5627718582f462e67a6f19591873fbd3a9b673d"}
Sep 08 17:06:36.687664 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:36.687379    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:36.705803 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:36.705729    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb" podStartSLOduration=1.70571254 podStartE2EDuration="1.70571254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 17:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:06:36.703618739 +0000 UTC m=+2192.407461740" watchObservedRunningTime="2026-09-08 17:06:36.70571254 +0000 UTC m=+2192.409555540"
Sep 08 17:06:37.243830 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:37.243802    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b24bq_37b10fba-cd73-4823-a265-170d76851a3f/dns/0.log"
Sep 08 17:06:37.264379 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:37.264354    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b24bq_37b10fba-cd73-4823-a265-170d76851a3f/kube-rbac-proxy/0.log"
Sep 08 17:06:37.334193 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:37.334160    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mzbwf_933cddf1-a897-4907-a4a7-6a1c09f95264/dns-node-resolver/0.log"
Sep 08 17:06:37.985285 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:37.985253    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-htghg_2df1a785-3dd3-4636-b3ea-c738d46b0e84/node-ca/0.log"
Sep 08 17:06:39.271968 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:39.271939    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7469867b85-2mtrm_2ee227a7-72da-4884-a3ed-afe188443ae8/kube-auth-proxy/0.log"
Sep 08 17:06:39.373361 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:39.373330    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pj92q_159ee2ab-6424-4294-80a7-440298e1ad38/payload-pre-processing/0.log"
Sep 08 17:06:39.445632 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:39.445605    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb6f6fcf8-cxp7q_272ce978-010b-40c1-bfa8-6e273be82289/router/0.log"
Sep 08 17:06:40.357969 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:40.357941    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dgxkx_2ba24b9b-ced8-4d3c-8f7e-6b7cc99693f3/serve-healthcheck-canary/0.log"
Sep 08 17:06:40.852207 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:40.852170    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-n5dsv_6ce3e03d-cc35-4f23-b7cf-209b3abb5edc/insights-operator/0.log"
Sep 08 17:06:40.852501 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:40.852483    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-n5dsv_6ce3e03d-cc35-4f23-b7cf-209b3abb5edc/insights-operator/1.log"
Sep 08 17:06:41.024168 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:41.024143    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swlqn_72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c/kube-rbac-proxy/0.log"
Sep 08 17:06:41.059954 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:41.059927    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swlqn_72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c/exporter/0.log"
Sep 08 17:06:41.083793 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:41.083752    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-swlqn_72ee6e8a-1f6b-48b9-86c4-641c9a1e7b5c/extractor/0.log"
Sep 08 17:06:42.702535 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:42.702501    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-5hsbb"
Sep 08 17:06:43.956976 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:43.956944    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-fqqgd_138ee252-68d1-4558-b0ad-13833bb4cfa8/manager/0.log"
Sep 08 17:06:43.973368 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:43.973341    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-fqqgd_138ee252-68d1-4558-b0ad-13833bb4cfa8/copy-manifests/0.log"
Sep 08 17:06:45.520088 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:45.520050    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76d8558585-lj6dv_5934c9b5-3fdc-4f8e-ae12-490eeb5e2372/manager/0.log"
Sep 08 17:06:45.577850 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:45.577805    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dq2x4_bd683fe1-bebe-4377-8e6b-c4157093baa7/openshift-lws-operator/0.log"
Sep 08 17:06:46.444535 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:46.444495    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7469867b85-2mtrm_2ee227a7-72da-4884-a3ed-afe188443ae8/kube-auth-proxy/0.log"
Sep 08 17:06:46.520563 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:46.520462    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pj92q_159ee2ab-6424-4294-80a7-440298e1ad38/payload-pre-processing/0.log"
Sep 08 17:06:46.578010 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:46.577981    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb6f6fcf8-cxp7q_272ce978-010b-40c1-bfa8-6e273be82289/router/0.log"
Sep 08 17:06:48.335901 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:48.335869    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7469867b85-2mtrm_2ee227a7-72da-4884-a3ed-afe188443ae8/kube-auth-proxy/0.log"
Sep 08 17:06:48.410283 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:48.410252    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-pj92q_159ee2ab-6424-4294-80a7-440298e1ad38/payload-pre-processing/0.log"
Sep 08 17:06:48.464596 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:48.464554    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb6f6fcf8-cxp7q_272ce978-010b-40c1-bfa8-6e273be82289/router/0.log"
Sep 08 17:06:51.374768 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:51.374711    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-qc9bz_3339a813-1197-4748-b594-af4a7bbfdf87/kube-storage-version-migrator-operator/1.log"
Sep 08 17:06:51.375622 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:51.375601    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-qc9bz_3339a813-1197-4748-b594-af4a7bbfdf87/kube-storage-version-migrator-operator/0.log"
Sep 08 17:06:52.480608 ip-10-0-129-146 kubenswrapper[2547]: I0908 17:06:52.480574    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4nnb6_5e252b5e-1f76-45e8-904f-b4c744adfc64/kube-multus/0.log"